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Abstract  of  Dissertation  Presented  to  the 
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COMPUTER-AIDED  TOLERANCE  DESIGN 
By 

Arthur  Robert  Thorbjornsen 
August,  1972 

Chairman;  Dr.  Stephen  W.  Director 
Major  Department:  Electrical  Engineering 

This  work  is  concerned  with  the  problem  of  the  assignment  of  tol- 
erances to  the  components  of  electrical  circuits  using  computer-aided 
design  techniques. 

The  major  existing  methods  of  variability  analysis  and  tolerance 
design  of  electrical  circuits  are  reviewed.  The  problems  of  circuit 
element  interdependence  are  studied  and  a method  is  presented  by  which 
correlated  sets  of  random,  normally  distributed  element  values  may  be 
generated.  This  method  permits  Monte  Carlo  analysis  of  circuits  having 
correlated  elements  for  which  measured  element  data  arenot  available. 

Two  new  computer-aided  design  algorithms  for  tolerance  design  are 
presented.  One  algorithm  is  for  the  continuous  tolerance  case  and  the 
other  is  for  the  discrete  tolerance  case.  Monte  Carlo  analysis  is  used 
in  the  main  iteration  loops  of  these  algorithms.  The  use  of  a variable 
sample  size  considerably  reduces  computation  time.  Both  algorithms  can 
produce  tolerance  designs  for  any  desired  circuit  yield. 
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CHAPTER  1 


INTRODUCTION 

An  important  part  of  electrical  circuit  design  is  the  assignment 
of  tolerances  to  the  components,  or  elements,  of  a circuit.  Given  a 
set  of  specified  circuit  performance,  or  response,  tolerances,  which 
usually  are  upper  and/or  lower  response  limits,  it  is  necessary  to 
select  element  tolerances  so  that  a specified  percentage  of  manufac- 
tured circuits  will  have  responses  that  are  within  the  limits.  A 
primary  interest  of  electrical  and  electronic  equipment  manufacturers 
is  to  produce  circuits  having  as  low  a cost  as  possible.  Since  the 
cost  of  electrical  components  is  roughly  inversely  proportional  to 
their  percent  tolerance, • it  is  desired  to  select  element  tolerances 
that  are  as  large  as  possible  but  such  that  the  circuit  design  specifi- 
cations are  still  met.  Thus,  the  problem  is  one  of  minimizing  circuit 
cost  at  the  same  time  as  the  element  tolerances  are  being  designed. 

This  work  is  an  attempt  to  solve  the  problem  of  tolerance  design 
by  the  application  of  modern  computer-aided  design  techniques  and  by 
the  development  of  new  methods  to  help  in  achieving  this  goal. 

Variability  analysis  is  a general  name  for  the  methods  of  analyzing 
the  statistical  characteristics  of  systems,  including  the  analysis  of 
performance  tolerances  [1] . Chapter  2 of  this  work  is  a study  of  the 
more  useful  methods  of  variability  analysis.  Several  researchers  have 
made  contributions  to  the  problem  of  tolerance  design.  Chapter  3 is  a 
summary  of  some  of  the  methods  developed  by  these  people. 


1 


2 


With  the  increased  use  of  integrated  circuits  an  important  new 
parameter  enters  into  circuit  design.  This  parameter  is  the  inter- 
dependence of  circuit  elements.  Since  most  of  the  elements  on  an  inte- 
grated circuit  are  made  of  the  same  materials,  it  is  obvious  that  a 
change  in  a material  parameter  (for  example,  the  resistivity)  that 
affects  the  value  of  one  circuit  element  will  also  affect  the  other 
elements.  The  problems  of  element  inderdependence  is  the  subject  of 
Chapter  4. 

The  Monte  Carlo  method  of  analysis  is  a mathematical  simulation 
of  the  construction  and  testing  of  a large  quantity  of  systems  [1]. 

Many  of  the  existing  methods  of  tolerance  design  employ  Monte  Carlo 
analysis.  However,  a satisfactory  method  for  simulating  large  quan- 
tities of  circuits  having  interdependent  elements  apparently  had  not 
been  developed.  Chapter  4 also  presents  a method  for  simulating  such 
circuits.  Associated  with  this  simulation  method  is  a proposed  hypoth- 
esis on  the  constraints  on  the  tolerances  of  interdependent  circuit 
elements . 

When  designing  tolerances  of  electrical  circuits,  there  are  two 
main  cases  which  are  encountered.  One  case  is  where  the  element  tol- 
erance is  a continuous  variable,  as  in  integrated  circuits,  and  the 
other  case  is  where  the  element  tolerance  is  a discrete  variable,  as 
in  discrete  circuit  elements.  In  the  first  case  the  element  tolerances 
can  assume  any  value  between  certain  limits  and  in  the  second  case  the 
tolerance  can  assume  only  a finite  number  of  fixed  values.  The  approaches 
to  computer-aided  tolerance  design  for  these  two  cases  must,  of  necessity, 
be  very  different.  Chapter  5 presents  a new  computer-aided  tolerance 
design  method  for  continuous  tolerance  case.  Several  examples  are  given 
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to  show  how  the  algorithm  works.  Chapter  6 presents  a new  computer- 
aided  tolerance  design  algorithm  for  the  discrete  tolerance  case. 
Example  solutions  are  also  given  for  this  algorithm.  The  final 
chapter,  Chapter  7,  summarizes  this  dissertation  and  also  points  out 
research  problems  which  follow  from  this  work. 


CHAPTER  2 


A SURVEY  OF  METHODS  OF  VARIABILITY  ANALYSIS 

Electrical  and  electronic  components,  which  are  used  in  the 
assembly  of  circuits,  have  parameter  values  that  are  distributed  about 
some  mean  value.  Such  distributions  are  an  inherent  characteristic  of 
the  manufacturing  processes.  Therefore,  the  responses  to  a specified 
input  of  a group  of  "identical"  circuits  are  distributed  about  some  mean 
response  value.  In  order  to  manufacture  circuits  that  will  operate 
reliably  it  is  necessary  to  be  able  to  predict  the  nature  of  the  response 
distribution,  e.g.,  the  mean  and  standard  deviation  or  the  maximum  spread 
and  the  shape  of  the  distribution.  The  methods  used  to  determine  distri- 
bution characteristics  are  generally  called  variability  analysis 
methods  [1].  In  this  chapter  we  describe  some  of  the  more  well  known 
methods  of  variability  analysis. 

2. 1 Worst  Case  Analysis 

The  most  commonly  used  method  of  variability  analysis  (at  least 
during  the  period  1962-1968)  is  the  worst  case  analysis  method  [1,2,3]. 
The  goal  of  worst  case  analysis  is  to  find  the  extreme  tolerance,  or 
distribution,  limits  of  a circuit  response,  A.  The  method  consists  of 
the  following  steps: 

(1)  Computation  of  all  partial  derivatives  of  A with  respect  to 
all  circuit  parameters,  or  elements,  p^. 


4 
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3A  8A  ^ 

3Pl’  9P2 9Pn  ■ 

(2)  Estimation  of  A^,  the  upper  limit  of  A,  by  adjusting  the 
element  values  to  the  extreme  tolerance  limits  at  which  the  partial 
derivatives  indicate  a maximum  response.  For  example,  if  element  p^ 
has  a positive  partial  derivative,  nominal  value  p^,  and  allowed 
tolerance  ±Ap^,  then  the  value  used  in  the  computation  of  A^  will  be 

pj  = Pi  + Ap^  . (2.1) 

If  element  p^  has  a negative  partial  derivative  the  value  will  be 

pV  = Pi  - Ap^  (2.2) 

and  if  the  partial  derivative  is  zero  the  nominal  value  will  be  used. 
The  value  of  A.,  is  then  computed  using  the  element  value  vector 


, U/  . U U 

(£  ) = (Pj^,  P2> 


. . p„)  . 


(2.3) 


(3)  Estimation  of  A^,  the  lower  limit  of  A,  by  adjusting  element 
values  in  a manner  opposite  to  that  of  step  (2),  e.g.,  for  a positive 
partial  derivative 


p.  = p.  - Ap.  , 

1 1 1 


for  a negative  partial  derivative 


Pi  = Pi  + Ap^  , 


and  for  a zero  partial  derivative 


(2.4) 


(2.5) 


Pi  = Pi  . 


(2.6) 


The  value  of  A^  is  then  computed  using  the  element  value  vector  £ . 

The  tolerances,  or  response  extremes,  computed  using  the  worst  case 


analysis  method  will  be  exact  only  in  the  case  where  all  partial 
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derivatives  do  not  change  sign  when  element  values  are  varied.  The  two 
hypothetical  examples  in  Figures  2-1 (a)  and  2-1 (b)  illustrate  the  effect 
of  sign  changes.  Each  of  the  examples  has  only  one  element,  p,  and  one 
response,  A.  In  case  (a)  the  upper  and  lower  worst  case  limits  are 
and  A2,  respectively,  while  the  actual  limits  are  A^  and  A^,  so  that 
the  worst  case  analysis  underestimates  the  actual  range  of  response 
deviation.  In  case  (b)  a worst  case  analysis  predicts  the  correct  range 
of  response  deviation,  but  the  upper  worst  case  response  estimate 
corresponds  to  the  lower  actual  response  value,  and  vice  versa. 

In  Figure  2-2 (a)  a simple  circuit  is  shown  for  which  a change  in 
partial  derivative  sign  does  occur  [4].  The  response  of  this  circuit 
is  V^,  the  voltage  across  element  R^.  The  expression  for  is  easily 
found  to  be 


^3 

^3  = R3R4+R3R5+R4R5 


(2.7) 


and  the  partial  derivatives  of  are 


and 


9V3 

R^R5(R^-R3> 

3R3  - 

(R3R^+R3R3+R^R3)^ 

3V3 

R3(2R3R3+R3^) 

9R, 

4 

(RjR^+RjRj+R^Rj)^ 

3V3 

-R3(2R3R4+R4^) 

SR^ 

(R3R^+R3R3+R^R3)^ 

(2.8) 


(2.9) 


(2.10) 


Using  the  element  values  R„  = = lOOJ^  ±10%  and  R,  = llOfi  ±10%  the 

3 5 4 

values  of  and  its  derivatives  are 


= 3.125  X 10  ^ volts. 


(2.11) 


(a) 


(b) 


Figure  2-1 

Examples  of  misleading  worst  case  analysis  results. 
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(a) 


(b) 


Figure  2-2 

(a)  Circuit  for  which  a change  in  partial  derivative  sign 
occurs.  (b)  Curve  of  versus  R^. 


(2.13) 


*''3  -3 

= 2.93  X 10  volts/f2, 


and 


9V 


3R 


^ = -3.33  X 10  ^ volts/fl. 


(2.1^) 


In  order  to  find  the  extreme  minimum  value  of  the  worst  case  analysis 

rules  prescribe  that  the  element  values  R_  = 90^2,  R,  = 99fl,  and  R^  = llOSl 

3 4 5 

be  used.  Computing  using  these  values  results  in 

Vg  = -3.33  X 10  ^ volts.  (2.15) 

If  the  values  of  R^  and  R^  are  fixed  at  99  and  llOJ^,  respectively,  and 
we  compute  using  any  value  of  R^  greater  than  90fi  we  find  that  the 

resulting  value  of  is  less  than  the  predicted  worst  case  minimum. 

For  example  if  R^  = llOi^  then  = -3.57  x 10  ^ volts.  This  flaw  in 
worst  case  analysis  results  from  a change  in  the  sign  of  a partial  de- 
rivative as  element  values  are  changed.  A plot  of  versus  R^ , with 
R^  = 99fi  and  R^  = llOJ^,  is  shown  in  Figure  2-2(b).  Here  we  see  that 
the  partial  derivative  of  with  respect  to  R^  is  indeed  negative, 
whereas  it  was  positive  with  all  resistors  at  their  nominal  values. 

In  situations  where  there  is  no  change  of  sign  of  partial  deriva- 
tives a worst  case  analysis  can  produce  highly  pessimistic  results, 
providing  the  element  value  distributions  can  be  approximated  by  normal 
distributions.  If  we  have  a normal  distribution  the  tolerance  can  be 
defined  to  be  equal  to  the  3o  points  on  the  normal  curve,  since  99.73% 
of  all  points  in  the  distribution  lie  between  the  3a  points  [5].  For 
such  a distribution  the  probability  that  one  element  value  will  equal 
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or  exceed  its  maximum  tolerance  value  is  roughly  0.00135.  Thus,  for  a 

circuit  with  n independent  elements,  the  probability  that  all  elements 

will  be  simultaneously  at  either  of  the  proper  worst  case  limits  is  of 

the  order  of  2(0.00135)^.  For  example,  for  a circuit  with  8 elements 

-23 

this  probability  is  2.21  x 10  . There  is  practically  no  chance  that 

the  true  worst  case  combination  of  element  value  will  occur  for  normal 
element  value  distributions. 

When  dealing  with  discrete  electrical  components,  however,  we  can- 
not always  assume  the  element  values  are  normally  distributed.  In  some 
cases  a component  will  be  produced  which  has  a bi-modal  distribution. 
This  type  of  distribution  can  be  produced  in  the  following  manner.  Let 
us  suppose  that  a large  batch  of  100  ohm  resistors  is  produced  having  a 
near  normal  distribution  and  a tolerance  of  10%.  Now  suppose  that  from 
this  batch  we  hand-pick  nearly  all  resistors  that  have  resistances 
between  95  and  105  ohms  (100  ohms  ±5%) . The  new  batch  of  5%  resistors 
will  obviously  have  a near  normal  distribution,  but  the  remaining  10% 
resistors  will  have  a distribution  with  the  greatest  concentration  of 
values  at  either  extreme.  The  resulting  distributions  are  shown  in 
Figure  2-3. 

Even  with  distributions  like  those  of  Figure  2-3(a),  the  probability 
is  still  very  small  that  all  elements  will  simultaneously  be  at  their 
worst  case  values. 


2 . 2 Variations  of  the  Worst  Case  Analysis  Method 

There  have  been  attempts  to  produce  less  pessimistic  worst  case 
tolerances  by  modifying  the  basic  worst  case  analysis  method.  In  the 
modification  known  as  the  Taylor  Worst  Case  Analysis  Method,  the 
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h IL. 

A 9p^ 


, must  be  inspected  in  order  to 


normalized  partial  derivatives 


Probability  of  Probability  of 


Original 

distribution 


(b) 


Figure  2-3 


Distributions  resulting  from  the  hand  selection  of  smaller 
tolerance  parts  from  a larger  tolerance  batch. 
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determine  the  most  critical  circuit  element  [6].  The  most  critical 
element  is  assigned  a worst  case  tolerance  that  is  equal  to  the  end-of- 
life  tolerance  for  that  element.  (The  end-of-life  tolerance^  takes  into 
consideration  the  drift  of  element  values  due  to  months  or  years  of 
environmental  stresses.)  The  remaining  circuit  elements  are  assigned 
initial  tolerances  and  regular  worst  case  analysis  procedure  is  followed. 

In  another  modification,  known  as  the  Quantized  Probability  Method, 
the  elements  are  separated  into  three  categories  [6].  The  categorization 
is  based  on  an  inspection  of  the  normalized  partial  derivatives  or  on 
prior  experience  with  similar  circuits.  The  first  category  consists  of 
elements  which  have  a pronounced  effect  on  the  circuit  response  and 
thus  are  assigned  end-of-life  tolerances.  The  second  category  consists 
of  elements  having  a moderate  effect  on  circuit  performance.  For  the 
second  category,  the  initial  tolerances  are  used.  The  third  category 
consists  of  elements  having  a slight  effect  on  circuit  performance. 

These  elements  are  assigned  a zero  tolerance.  The  regular  worst  case 
analysis  procedure  is  followed  to  compute  the  circuit  response  tolerance. 

Even  though  the  modified  versions  of  the  worst  case  analysis  method 
produce  less  conservative  approximations  of  the  response  tolerance, 
they  can  still  produce  uncertain  results  because  of  partial  derivatives 
that  change  sign. 

2.3  Element  Value  Intercepts  and  Large  Change  Sensitivities 

Somewhat  akin  to  a tolerance  analysis  is  the  computation  of  element 
value  intercepts.  The  concept  of  intercepts  was  introduced  by  Butler  [7]. 


Burns  and  Lawson  give  a practical  design  example  in  which  the  end-of- 
life  tolerances  are  nearly  twice  the  initial  tolerances  [2]. 
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The  upper  and  lower  intercepts  for  an  element,  p , are  computed  by 

^ . 

varying  only  that  element  while  maintaining  all  other  elements  at  their 
nominal  values.  The  upper  intercept  of  p,  , I^,  is  defined  as  the  per- 
cent  positive  deviation  from  the  nominal  value  of  p,  at  which  the 
circuit  response  first  exceeds  its  tolerance  limits.  The  lower  inter- 
cept, Ij^,  is  defined  as  the  percent  negative  deviation  from  the  nominal 
value  of  Pj^  at  which  the  circuit  response  first  exceeds  its  tolerance 
limits. 

Figure  2-4  illustrates  a hypothetical  curve  of  a circuit  response, 

/S 

A,  versus  an  element  p^^.  On  this  graph  are  shown  the  nominal  values  A 

and  p,  and  the  specified  response  tolerances  A and  A , . As  the 
k max  min 

value  of  Pj^  is  increased  from  its  nominal  value  we  see  that  the  upper 
response  tolerance  is  reached  when  p = b.  If  the  value  of  p,  is 

tC 

decreased  the  upper  response  tolerance  is  again  reached  when  Pj^  = a. 

For  this  simple  example  the  upper  intercept  is 


I 


+ 

k 


(100%) 


and  the  lower  intercept  is 


(100%)  . 


The  intercepts  of  an  element  can  be  used  to  calculate  its  large 
change  sensitivities.  The  upper  large  change  sensitivity,  L^,  is  the 
inverse  of  the  upper  intercept. 


(2.16) 


and  the  lower  large  change  sensitivity  is  minus  the  inverse  of  the  lower 
intercept. 
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Figure  2-4 

Example  showing  large  change  intercepts. 
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(2.17) 


Elements  whose  variation  causes  large  variations  in  the  circuit  response 
will  accordingly  have  large-valued  large  change  sensitivities. 


2.4  The  Moment  Method 

In  general,  worst  case  analysis  methods  are  nonstatistical . 
Statistical  quantities  such  as  the  mean  and  variance  of  a response  dis- 
tribution, or  even  measures  of  how  the  distribution  is  skewed  or  how 
peaked  it  is,  are  usually  of  interest.  To  compute  these  quantities  we 
may  use  the  moment  method  [1,8].  The  mean  and  variance  of  a statistical 
distribution  correspond  to  the  center  of  mass  and  moment  of  inertia, 
respectively,  of  a physical  object,  hence  the  name  moment  method.  When 
using  the  moment  method  it  is  assumed  that  all  element  value  distribu- 
tions are  approximately  normal. 

To  find  the  approximate  tolerance,  or  variance,  of  a circuit 
response  we  can  solve  the  propagation  of  variance  equation  (derived  in 
Appendix  A) , 


T 

a 

-P 


[X]  a 


where  is  the  variance  of  the  response  A, 
is  the  vector  of  element  standard  deviations. 
The  (i,j)th  term  of  [X]  is 


(2.18) 


) 


^1  ^2  ^n 

and  [X]  is  an  n X n matrix. 


3A  9A 

^ij  *^ij  3p.  3p.  ’ 


(2.19) 


where  p,.  is  the  correlation  coefficient  between  elements  p,  and  p . 

(p^^  = 1.0),  and  the  partial  derivatives  are  evaluated  using  the  nominal 


circuit  element  values. 
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Equation  (2.18)  is  derived  using  a Taylor  series  expansion  of  A(£), 
the  general  circuit  response  function.  Since  no  higher  than  second 
order  terms  are  present  in  (2.18)  only  approximate  results  will  be 
obtained.  However,  if  all  partial  derivatives  remain  constant  over  the 
range  of  element  variation  equation  (2.18)  should  be  exact.  Otherwise, 
in  order  to  obtain  more  accurate  results,  the  propagation  of  variance 
equation  having  higher  order  terms  may  be  employed.  Hahn  and  Shapiro 
have  derived  higher  order  expressions  for  the  mean,  variance,  skewness, 
and  kurtosis  of  a distribution  [8]. 

The  general  moment  method  equations  can  be  used  for  any  type  of 
element  value  distribution.  The  use  of  a normal  distribution  was  sug- 
gested above  just  to  provide  a simple  relationship  between  tolerance 
and  variance. 

The  moment  method  is  probably  the  easiest  tolerance  analysis  to 
perform,  in  terms  of  circuit  analysis,  because  all  that  is  necessary 
is  to  compute  the  first  order  partial  derivatives. 

2.5  The  Monte  Carlo  Method 

The  variability  analysis  method  that  provides  the  most  exact 
information  is  the  Monte  Carlo  method  [1,8].  In  Monte  Carlo  analysis 
we  simulate  mathematically  the  construction  and  testing  of  a large  num- 
ber of  circuits  to  determine  the  actual  circuit  responses  when  circuit 
element  values  are  randomly  selected  from  their  respective  distribu- 
tions. The  resulting  response  data  may  be  plotted  as  a histogram  to 
show  the  distribution  shape.  The  mean  and  variance  of  the  response 
distribution  may  easily  be  calculated  from  the  response  data. 

The  first  step  in  the  Monte  Carlo  method  is  to  generate  a table  of 
random  element  values  (one  column  for  each  element  and  as  many  rows  as 
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there  are  samples).  One  way  to  obtain  element  values  is  simply  to 
measure  the  parameter  values  for  a large  number  of  elements  and  tabu- 
late the  results.  A much  faster  method  is  to  use  a computer  subroutine 
that  generates  random  numbers.  Thus  a table  of  random  element  values 
can  be  produced  by  specifying  only  the  desired  mean,  desired  standard 
deviation,  and  a seed  integer  to  start  the  number  generator.  It  is 
possible  to  generate  many  types  of  distributions  starting  from  a uni- 
form distribution  [9].  Standard  programs  exist  for  the  generation  of 
uniform  and  normal  distributions  [10] . The  most  difficult  part  of 
generating  distributions  is  including  correlation,  or  linear  dependence, 
between  two  or  more  circuit  elements.  A method  for  generating  corre- 
lated distributions  is  presented  in  Chapter  4. 

The  second  step  in  Monte  Carlo  analysis  is  to  perform  a network 
analysis  for  each  set  of  element  values  (each  row  in  the  element  value 
table) , using  any  standard  network  analysis  program.  The  circuit 
responses  are  then  tabulated  and  plotted  or  used  for  further  calcula- 
tions of  statistical  quantities. 

Since  the  Monte  Carlo  method  provides  only  a finite  sampling  of  a 

continuous  distribution,  the  accuracy  of  the  results,  or  the  confidence 

that  one  can  have  in  the  results,  is  directly  proportional  to  the 

sample  size.  In  order  to  have  a high  degree  of  confidence  in  the  results 

a large  sample  size  should  be  used.  However,  the  larger  the  sample  size, 

the  more  computation  time  required.  This  large  amount  of  computation 

is  the  primary  disadvantage  of  the  Monte  Carlo  method.  An  idea  of  the 

accuracy  that  is  associated  with  various  sample  sizes  may  be  gained 

from  the  following  statement,  which  applies  to  any  type  of  distribution 

20 

[11]:  For  a sample  size  of  100  there  is  a 0.95  probability  of  finding 

300 
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78.4 


95.4  % of  the  population  between  the  sample  extremes,  and  a 0.99 


98.5 

probability  of  finding 
extremes . 


71.2 

93.6  % of  the  population  between  the  sample 
97.9 


2.6  The  Approximate  Monte  Carlo  Method 

In  an  effort  to  reduce  the  lengthy  network  analysis  required  by 
the  Monte  Carlo  method,  Temes,  Ebers,  and  Gadenz  have  developed  a 
method  which  is  an  approximation  of  Monte  Carlo  [12].  The  method  is 
based  on  the  assumption  that  the  partial  derivatives  of  the  response, 

A,  change  very  little  over  the  range  of  element  variation.  This 
assumption  is  the  same  as  is  made  when  using  the  propagation  of  vari- 
ance equation,  (2.18).  Generally,  both  methods  are  useful  when  dealing 
with  circuits  in  which  all  elements  have  very  small  tolerances. 

Instead  of  performing  a network  analysis  for  each  row  of  the 
element  value  table,  the  Approximate  Monte  Carlo  method  only  computes 
the  partial  derivatives  with  respect  to  each  element,  using  nominal 
element  values.  The  evaluation  of  all  first  order  partial  derivatives 
requires  no  more  than  two  network  analyses  if  the  adjoint  circuit 
technique  is  employed  [13]. 

From  the  partial  derivatives  and  element  value  table,  the  set  of 
approximate  response  values  is  computed  using  the  expression 


A(£  ) = A(£)  + I 


9A 


• S 3p.  ’ 

j=l  -’k 


(2.20) 


which  is  merely  a Taylor  series  expansion  of  the  response,  A(£),  about 

the  nominal  point,  £,  in  which  all  terms  higher  than  first  order  have 

been  eliminated,  circuit  response  using  the  k-th  set  of 

element  values,  A(£)  is  the  response  using  nominal  element  values,  p. 

^k 
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is  the  k-th  value  for  element  p.,  p.  is  the  nominal  value  of  element  p , 

1 J J 

and  n is  the  number  of  circuit  elements. 

As  we  can  see  from  equation  (2.20)  the  mean  response  is  equal  to 
the  nominal  response,  which,  in  reality,  is  often  not  true.  Also,  the 
most  common  element  tolerances  used  in  practice  (both  for  integrated 
and  discrete  circuits)  are  of  the  order  of  5 to  20%,  which  cannot  be 
classified  as  small.  Thus,  the  usefulness  of  both  the  Approximate  Monte 
Carlo  method  and  the  low  order  moment  method  are  somewhat  restricted. 

At  this  time  the  only  variability  analysis  method  which  produced  exact 
results  is  the  standard  Monte  Carlo  method. 


CHAPTER  3 


A SURVEY  OF  TOLERANCE  DESIGN  METHODS 

Previously  we  have  been  concerned  with  methods  of  variability,  or 
tolerance,  analysis.  Now  we  must  see  how  these  and  other  methods  have 
been  used  to  select  circuit  element  tolerances  so  that  the  manufactured 
circuit  will  have  a response  that  is  within  a prescribed  tolerance. 

For  some  simple  circuits,  such  as  a single  transistor  amplifier, 
worst  case  constraints  can  be  incorporated  into  the  design  equations. 
But,  for  highly  complex  circuits,  adding  worst  case  constraints  can  be 
an  impossible  task  and  the  element  tolerances  must  be  arrived  at  by 
other  means. 

We  will  now  review  some  of  the  more  useful  methods  of  tolerance 
design. 

3.1  Trial  and  Error 

The  most  elementary  form  of  tolerance  design  is  by  the  method  of 
trial  and  error.  Starting  with  a designed  circuit,  the  method  typically 
is  performed  using  the  following  steps. 

(1)  Estimate  initial  values  for  the  element  tolerances. 

(2)  Compute  the  circuit  response  tolerances  for  the  current  set 
of  element  tolerances.  (This  is  done  preferably  by  a computer  using 
worst  case  analysis,  the  moment  method,  or  Monte  Carlo  analysis.) 

(3)  Compare  the  computed  response  tolerances  with  the  desired 
response  tolerances.  If  the  computed  values  are  equal  to  or  less  than 
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the  desired  values  the  procedure  may  end.  If  the  computed  responses 
are  too  large  the  element  tolerance  values,  and  sometimes  the  element 
nominal  values,  are  adjusted  and  we  return  to  step  (2). 

Probably  the  most  advanced  form  of  the  trial  and  error  procedure 
is  the  interactive  computer  approach  of  Bohling  and  O'Neill  [14].  This 
method  utilizes  an  on-line  computer  terminal  with  a graphic  display. 

A high  speed  circuit  analysis  program  is  used  to  perform  Monte  Carlo 
analyses.  Using  this  setup,  a designer  reads  into  the  computer  the 
circuit  topology,  nominal  element  values,  and  tolerance  values.  The 
computer  next  performs  a Monte  Carlo  analysis  and  displays  the  results. 
The  designer  then  can  adjust  values  until  the  desired  response  toler- 
ances are  obtained.  The  system  can  also  be  operated  in  a hybrid  mode 
for  additional  versatility. 

3. 2 Two-at-a-Time  Parameter  Variation 

A rather  old  method  of  tolerance  assignment  is  the  Two-at-a-Time 
Parameter  Variation  Method  [3] . In  this  method  two-dimensional  plots 
are  made  for  all  pairs  of  parameters.  Each  plot  consists  of  curves 
indicating  the  boundaries  of  a region  of  element  values  producing 
acceptable  responses.  On  these  two-dimensional  plots  the  region  of 
possible  values  of  the  two  elements  appears  as  a rectangle.  The  object 
then  is  to  select  element  tolerances  so  that  all  rectangles  of  possible 
element  values  are  within  all  regions  of  values  producing  acceptable 
responses.  In  the  two-at-a-time  variation  all  elements  except  the  pair 
in  question  are  kept  at  their  nominal  values. 

The  relationship  between  the  region  of  possible  values  and  the 
acceptable  region  is  illustrated  in  Figures  3-1  (a)  and  (b).  Figure 
3-1 (a)  shows  a simple  voltage  divider  circuit  with  an  output  of  40.0 
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300J^ 


(a) 


(b) 

Figure  3-1 

(a)  Voltage  divider  circuit.  (b)  Plot  showing  region  of  possible 
values  and  region  of  acceptability  for  the  voltage  divider  circuit. 
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volts  and  a desired  response  tolerance  of  ±4.0  volts.  Figure  3-1 (b) 

is  a plot  of  R2  vs.  R^.  The  region  of  acceptable  responses  (i.e., 

36.0  volts  < V <44.0  volts)  is  the  area  between  the  two  diagonal 
out  - 

solid  lines.  The  region  of  possible  values  is  the  area  within  the 
dotted  rectangle.  In  this  case  it  is  assumed  that  the  tolerance  for 
both  R^  and  R^  is  ±50.0  ohms. 

3.3  Karafin*s  Method 

The  extension  and  refinement  of  the  Two-at-a-Time  Parameter 
Variation  method  was  done  by  Karafin  and  Butler  [15,7].  Butler  defined 
the  region  of  acceptability,  R^,  as  ".  . .a  connected  region  in  param- 
eter space  such  that  the  nominal  design  is  in  R^  and  such  that  for  all 
realizations  in  R^  the  corresponding  performance  is  acceptable." 
Further,  he  defined  a two-dimensional  performance  contour  as  the  bound- 
ary of  R^  in  the  two-dimensional  subspace  of  concern. 

Karafin' s method,  which  is  used  for  discrete  circuits,  begins  by 
taking  all  possible  pairs  of  parameters  and  forming  tables  of  pairs  of 
tolerances  for  which  circuit  performance  remains  acceptable.  In  this 
method  we  are  allowed  only  a finite  number  of  tolerance  values,  such 
as  1.0,  2.0,  5.0,  or  10.0%,  which  is  the  case  with  discrete  elements. 

After  all  tables  of  tolerance  pairs  (or  pairwise  constraints)  are 
formed,  the  next  step  is  to  assign  some  tolerance  cost  formula  (Karafin 
uses  the  formula  that  cost  is  equal  to  the  inverse  of  the  percent 
tolerance)  and  then  to  find  the  set  of  tolerance  values,  for  all  param- 
eters, that  has  the  lowest  cost  and  also  satisfies  the  pairwise  con- 
straints. The  least  costly  tolerance  set  is  found  by  means  of  an  effi- 
cient tree-search  procedure.  A tree  search  is  employed  because  we  are 
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searching  for  one  of  a large,  finite  number  of  points  in  an  n-dimensional 
space,  a situation  in  which  we  cannot  efficiently  use  a gradient  type 
of  search  technique.  Using  the  tolerance  values  of  the  cheapest  set  a 
worst  case  analysis  is  performed  to  see  if  the  circuit  performance 
remains  within  the  region  of  acceptability  when  all  elements  vary  simul- 
taneously. If  the  worst  case  test  passes,  then  a Monte  Carlo  analysis 
is  conducted.  If  either  the  worst  case  or  Monte  Carlo  analyses  indicate 
that  circuit  performance  can  be  unacceptable,  then  the  next  least  costly 
set  of  tolerances  is  found  and  the  process  repeated  until  a set  of 
tolerances  is  found  that  guarantees  acceptable  performance. 

Karafin's  method  does  not  take  into  consideration  correlation 
between  circuit  elements.  Moreover,  this  method  assumes  that  a 100% 
yield  is  desired,  i.e.,  that  all  manufactured  circuits  operate  within 
tolerance.  The  utility  of  Karafin's  method  seems  to  be  restricted  when 
we  consider  integrated  circuits  because  with  this  type  of  circuit  there 
is  always  correlation  and  tolerances  can  take  on  practically  any  value. 

3.4  Adby's  Method 

A tolerance  design  method  which  utilizes  the  moment  method  and 
Monte  Carlo  analysis  is  Adby's  method  [16].  This  method  is  based  on 
the  assumption  that,  near  the  solution,  the  element  standard  deviations 
are  linearly  proportional  to  the  response  standard  deviations.  The 
objective  is  to  compute  the  element  standard  deviations  such  that  there 
will  be  a probability,  P,  that  the  responses  at  m frequency  points  will 
be  within  tolerance. 

To  facilitate  the  discussion  we  define 


2a  = 


(3.1) 
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where  is  the  vector  of  m response  standard  deviations,  ^ is  the 
vector  of  m desired  response  tolerances,  and  k is  a constant.  The  value 
of  k is  initially  set  equal  to  1.0.  For  each  of  the  m frequency  points 
we  have  a separate  moment  method  equation  (of  the  form  of  (2.18)). 


2 T 


“P 


2 T 

a:  = a [X  ] a 
A — p m — p 


(3.2) 


The  first  part  of  the  procedure  is  to  solve  the  set  of  m moment 
method  equations  for  the  vector  of  n element  standard  deviations, 
which  is  necessary  to  produce  £^  = £.  The  equations  are  solved  using 
an  iterative  least  squares  technique.  The  second  part  of  the  procedure 
is  to  find  the  constant,  k,  by  which  must  be  multiplied  in  order 
that  the  circuit  responses  are  within  tolerance  with  probability  P. 

This  second  part  is  an  iteration  loop  consisting  of  the  following 
steps : 


(1)  Compute  an  initial  estimate  of  k; 

(2)  Perform  a Monte  Carlo  analysis  using  element  standard  devia- 
tions ka  . From  the  results  compute  the  actual  value  of  P; 

“P 

(3)  Using  the  desired  value  of  P,  solve  the  multidimensional 
probability  integral,  equation  (3.3),  for  a more  accurate  value  of  k. 
Return  to  step  (2). 

Sometimes  it  is  necessary  to  try  several  different  values  of  k in 
order  to  derive  a relationship  between  k and  P.  From  this  relationship 
the  proper  value  of  k can  be  obtained. 

In  step  (3),  above,  the  multidimensional  probability  integral 


solved  for  k is 
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P = 


(-A  +e 
m m 
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exp 
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2k 

dx. 


. dx 


m 


(3.3) 


where  [Q]  is  an  mxm  matrix  with  (i,j)th  element  q..  = (a.  0.0.  ),  X 

i'l 

1 j ij 

is  an  m vector  with  i-th  element  X.  = x.-A.,  A.  is  the  mean  value  of 

1 1X1 

the  i-th  response,  and  p is  the  correlation  coefficient  for  responses 

A , , 

ij 

i arri  j . Equation  (3.3)  assumes  that  we  are  dealing  with  normal  dis- 
tributions. The  estimate  of  k obtained  in  step  (1)  is  from  the  solution 
of  a one-dimensional  approximation  of  (3.3), 
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V^I 


exp 


2 2 2 
-(x-A^)  /2k  e^ 


dx. 


(3.4) 


Ai-ei 


Equations  (3.3)  and  (3.4)  are  solved  by  a numerical  integration  technique. 

The  element  standard  deviation  values,  in  a , that  are  calculated 

-P’ 

by  the  above  method  will  usually  be  the  easiest  obtainable  values  that 
will  satisfy  the  response  tolerance  specifications.  Often  there  is  a 
more  optimum,  or  larger,  set  of  element  standard  deviations  that  will 
work  just  as  well.  The  way  Adby's  method  selects  a more  optimum  set  is 
to  determine  the  element  correlation  coefficients  that  maximize  the 
element  standard  deviations.  This  method  of  optimizing  element  standard 
deviations  is,  at  best,  questionable  because  it  is  not  clear  how  prac- 
ticable it  is  to  alter  element  correlation  coefficients.  Conceivably 
such  alteration,  if  possible,  could  entail  high  costs  in  a circuit’s 
fabrication.  In  some  cases,  the  increase  of  costs  could  be  higher  than 
the  savings  realized  by  using  larger  tolerance  elements. 

Adby's  method  considers  circuit  element  correlation  in  the  moment 
method  equation;  however,  he  does  not  state  if  correlation  is  considered 
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during  the  Monte  Carlo  analysis.  In  order  to  produce  accurate  results, 
a Monte  Carlo  analysis  must  take  into  consideration  the  correlation  of 
circuit  elements,  when  it  exists. 


3 . 5 The  Method  of  Seth  and  Roe 

Seth  and  Roe  have  made  use  of  the  higher  order  statistical  moment 
equations  in  a tolerance  assignment  algorithm  [17].  Expressions  are 
easily  derived  for  the  moments  of  a network  response  in  terms  of  the 
moments  of  the  network  elements.  If  the  values  of  the  statistical 
moments  of  a distribution  (mean,  variance,  skewness,  kurtosis,  etc.) 
are  known,  then  the  distribution  is  completely  described.  Since  the 
tolerance  of  a distribution  can  be  related  to  its  statistical  moments 
it  is  possible  to  obtain  expressions  for  the  various  response  moments 
in  terms  of  the  element  tolerances.  It  is  necessary  to  have  a set  of 
response  moment  equations  for  each  frequency  point  of  interest.  The 
coefficients  used  in  the  moment  expressions  are  partial  derivatives  of 
the  circuit  responses  of  first  and  higher  order.  These  partial  deriva- 
tives are  calculated  using  the  adjoint  circuit  technique.  Since  the 
circuit  in  question  is  to  have  specified  tolerances,  then  the  appro- 
priate constraints  must  be. placed  on  the  response  moments. 

An  objective  function  for  the  circuit  is  the  summation  of  element 
costs,  giving  the  total  circuit  cost, 

n a. 


C 


T 


I 

i=l 


2 

t. 


(3.5) 


1 

where  t.  is  the  tolerance  of  the  (i)th  element,  a.  is  a constant 
1 1 

dependent  on  the  element  type,  and  n is  the  number  of  elements.  This 
objective  function  is  minimized  subject  to  the  constraints  placed  on 
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the  element  tolerances.  The  objective  function  is  minimized  using  the 
Gradient  Projection  method  for  constrained  optimization,  which  is  a 
method  that  requires  analytic  expressions  for  the  partial  derivatives 
of  the  constraint  equations  but  not  of  the  objective  function. 

The  element  tolerances  in  this  method  are  continuous  variables. 

The  result  of  the  minimization  is  a set  of  element  tolerances  which 
produces  the  desired  response  moments  as  well  as  producing  a minimum 
cost  circuit.  The  results  are  then  verified  by  use  of  a Monte  Carlo 
analysis. 

The  Seth-Roe  method  can  be  used  to  design  tolerances  for  a less 
than  100%  yield  by  altering  the  objective  function  so  that  there  will 
be  a trade-off  between  cost  and  probability  of  failure.  The  method 
cannot  be  used  for  circuits  that  have  correlated  elements  nor  for  dis- 
crete tolerances. 

3. 6 The  Method  of  Pinel  and  Roberts 

A tolerance  assignment  algorithm  similar  to  the  one  just  described 
is  the  method  of  Pinel  and  Roberts  [18].  The  approach  used  in  this 
method  is  to  first  compute  the  deviation,  Af (w, Ap) , from  the  nominal 
circuit  response,  f(w,2^),  which  is  caused  by  a change  in  the  circuit 
element  values,  Normally  Af  would  be  computed  by  means  of  the  large 

change  sensitivity  method,  but,  in  order  to  conserve  computation  time, 
an  approximate  solution  is  obtained  through  the  use  of  the  Taylor  series 
expansion. 


n n 


IX  ^ f <•  XX  LX 

Af(^)  = I M-^Pi  +TT  I I 


3 f 


. ^ 3p.9p  ^^i^Pk 

1=1  k=l  *^1  *^k 
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3'  ^ ^ ^ 3d  3o  3o  ^Pi^Pk^Pfi, 

i=l  k=l  Z=1  ^Pi'^Pk^Pj,  1 


(3.6) 
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Up  through  third  order  terms  are  included  in  the  Taylor  series  expansion, 
but  element  interaction  terms  are  excluded.  As  in  the  Seth-Roe  method, 
the  partial  derivatives  of  the  circuit  response  are  obtained  through  the 
use  of  the  adjoint  circuit  technique. 

The  maximum  allowable  deviation  from  the  nominal  circuit  response 
is  G (only  an  upper  limit  will  be  considered  in  this  description).  A 
constraint  equation  applicable  to  the  circuit  response  is  then 

g(^)  = G - Af(^)  > 0 . (3.7) 


Since  Ap^  is  related  to  the  element  tolerance,  t^,  the  constraint 
equation  can  be  written  in  terms  of  the  element  tolerances. 

The  cost  function  used  in  the  Pinel-Roberts  method  is  simply  the 
total  circuit  cost 

n a , 

Ct  = I e.  + — . (3.8) 

i=l  i 

where  n is  the  number  of  circuit  elements  and  6.  and  a.  are  constants 

1 1 

that  depend  on  the  element  type.  An  objective  function  is  formed  from 
the  cost  function  and  is 


P(r,t) 


+ r 


m 


(3.9) 


where  r is  a constant  and  m is  the  number  of  constraint  equations 
(corresponding  to  the  number  of  frequency  points). 

In  order  to  obtain  a solution  to  the  tolerance  assignment  problem 
it  is  necessary  to  minimize  equation  (3.9),  which  is  carried  out  by  the 
Fiacco-McCormick  approach.  The  objective  function  is  minimized  with 
respect  to  while  r is  held  constant,  using  the  Fletcher-Powell 
method.  The  minimization  is  repeated  using  successively  smaller  values 
of  r until  the  penalty  function  portion  is  only  a small  part  of  P(r,0, 
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at  which  time  the  constrained  minimum  of  is  assumed  to  be  found. 

The  solution  is  in  terms  of  continuous  tolerances. 

Pinel  and  Roberts  take  care  of  discrete  tolerances  by  the  following 
procedure.  The  continuous  solution  is  used  as  a starting  point.  First 
one  element  tolerance  is  fixed  at  the  closest  discrete  value  and  the 
preceding  solution  is  repeated  using  n-1  variables.  Then  another 
element  tolerance  is  fixed  at  a discrete  value  and  the  procedure  re- 
peated for  n-2  variables.  This  process  continues  until  all  of  the 
element  tolerances  have  been  fixed  at  discrete  values. 

The  major  limitations  of  the  Pinel-Roberts  method  are  that  (1)  it 
cannot  take  into  account  correlation  between  circuit  elements  and  (2) 
the  discrete  solution  is  not  guaranteed  to  be  the  one  with  minimum  cost 
since  not  all  variables  are  considered  simultaneously. 


CHAPTER  4 


PROBLEMS  OF  ELEMENT  INTERDEPENDENCE 

4 . 1 Linear  Correlation  Between  Circuit  Elements 

Present  integrated  circuit  technology  requires  circuit  designers 
to  consider  the  dependence  (correlation)  of  the  value  of  one  circuit 
element  on  (with)  others.  An  example  of  linearly  correlated  elements 
is  an  integrated  circuit  in  which  all  of  the  resistors  are  made  of  the 
same  resistive  material  and  by  the  same  technique.  For  this  case, 
assuming  the  resistive  material  is  homogeneous  and  of  uniform  thick- 
ness, any  variation  of  the  material  resistivity  or  thickness  will  cause 
a variation  of  resistance,  uniformly,  in  all  of  the  resistors.  If  we 
assume,  further,  that  no  other  resistor  parameter  varies,  then  all 
resistors  in  the  circuit  will  be  perfectly  linearly  correlated.  Per- 
fect correlation  between  two  elements  is  illustrated  by  the  scatter 
diagram  in  Figure  4-1 (a).  Variation  of  other  resistor  parameters,  such 
as  length  and  width,  and  non-uniform  variation  of  material  thickness 
and  homogeneity  will  usually  produce  non-correlated  resistance  varia- 
tions and  will  cause  the  resistors  to  have  non-perfect  correlation. 

An  example  of  nonperfect  correlation  is  shown  in  Figure  4-1 (b). 

In  the  case  of  linearly  correlated  elements  it  is  possible  to  com- 
pute a linear  relationship  between  the  values  for  element  p^  and  ele- 
ment P2  of  the  general  form  p^  = method  of  least 

squares.  Also,  one  may  compute  the  coefficient  of  linear  correlation 
between  elements  p^  and  119]. 
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(b) 


Figure  4-1 


Scatter  diagrams  illustrating,  (a),  perfect  correlation  and, 
(b),  nonperfect  correlation. 
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N 


12 


I [Pi  -E(P^)][P2  -E(p2)] 

1=1  i i 

Na  a 

Pi  P2 


(4.1) 


where  E(p^)  is  the  expected,  or  mean,  value  of  p^,  p^  is  the  (i)th 

i 

value  of  the  set  of  values  of  p^,  and  N is  the  number  of  samples,  or 
value  pairs  of  p^  and  The  value  of  can  vary  between  +1.0  and 

-1.0,  its  sign  being  the  same  as  that  of  the  slope  d^^*  Tn  Figure  4-l(a) 
p^2  Ts  equal  to  +1.0  and  in  4-1 (b)  the  value  is  somewhere  between  0.0 
and  +1.0. 


4. 2 Types  of  Interdependence  Encountered  in  Practice 

In  order  to  learn  how  the  elements  of  an  integrated  circuit  chip 
are  interdependent,  measured  element  values  were  obtained  for  two  sets 
of  integrated  circuits  [20,21].  All  of  the  elements  in  both  sets  are 
diffusion  type  resistors.  In  set  1,  the  data  for  which  are  listed  in 
Table  4-1,  the  resistors  were  fabricated  using  different  techniques. 
Resistor  lA  is  a "pinch"  type  of  resistor,  resistor  IB  is  a "base"  type, 
and  resistor  1C  is  an  "emitter"  type.  The  "base"  resistor  is  formed 
in  the  same  way  as  is  the  base  of  an  npn  transistor.  A p-type  region 
is  diffused  into  an  n-type. collector  region  [22].  Resistor  terminals 
are  connected  to  opposite  ends  of  the  p-type  region.  The  "emitter" 
resistor  is  formed  by  diffusing  an  n'^'-type  (heavily  doped  n-type)  re- 
gion into  the  base  region  with  terminals  attached  to  opposite  ends  of 
the  n"^-type  region.  The  "pinch"  resistor  is  formed  in  the  same  way  as 
the  "emitter"  resistor  except  that  the  n"^-type  region  is  placed  cross- 
wise over  the  p-type  diffused  resistor  [23].  The  terminals  are  at- 
tached to  the  p-type  region  on  opposite  sides  of  the  n"^-type  region. 
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Table  4-1 


Experimental  values  of  normalized  resistance  for  three 
resistors  made  by  different  techniques  on  the  same 
integrated  circuit. 


Normalized 

Resistance 

Values 

Resistor 

Resistor 

Resistor 

Chip 

lA 

IB 

1C 

1 

0.8790 

0.9329 

1.0439 

2 

0.8863 

0.9329 

1.0220 

3 

0.9703 

0.9821 

1.0343 

4 

0.9801 

0.9788 

1.0627 

5 

0.9850 

0.9617 

1.0889 

6 

0.9018 

0.9360 

1.0503 

7 

0.8749 

0.9267 

0.9882 

8 

0.9573 

0.9329 

1.0300 

9 

0.9263 

0.9329 

0.9920 

10 

0.9018 

0.9455 

0.9920 

11 

0.9353 

0.9553 

1.0048 

12 

0.9989 

1.0253 

1.0343 

13 

1.0845 

1.1019 

1.1087 

14 

1.1848 

1.1106 

1.0648 

15 

1.1995 

1.1064 

1.0300 

16 

1.2508 

1.0977 

0.9936 

17 

1.1783 

1.0933 

1.0262 

18 

0.8497 

0.9553 

0.9395 

19 

0.8635 

0.9455 

0.9480 

20 

0.9850 

0.9821 

0.9250 

21 

0.9703 

0.9718 

0.9234 

22 

0.9263 

0.9651 

0.9340 

23 

0.8937 

0.9393 

0.9512 

24 

0.9263 

0.9329 

0.9614 

25 

0.9263 

0.9360 

0.9512 

26 

0.8937 

0.9519 

0.9566 

27 

0.9141 

0.9586 

0.9598 

28 

0.9263 

0.9586 

1.0011 

29 

0.9663 

1.0177 

1.0712 

30 

1.0731 

1.0807 

0.9882 

31 

1.1579 

1.1151 

0.9737 

32 

1.2060 

1.1196 

0.9775 

33 

1.2133 

1.1151 

0.9791 

34 

1.2133 

1.1019 

0.9920 

Mean  Value 

12,263.8f2 

3,572. 79J2 

18.67J^ 

Normalized 

Standard 

Deviation 

0.12433 

0.07196 

0.04822 
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Scatter  diagrams  for  the  first  set  of  resistors  are  drawn  in 
Figure  4-2.  Figure  4-2 (a)  is  the  scatter  diagram  of  resistor  IB  versus 
resistor  lA  and  Figure  4-2 (b)  is  the  scatter  diagram  of  resistor  1C 
versus  resistor  lA. 

The  data  for  the  second  set  of  resistors  are  listed  in  Table  4-2. 
In  this  case  all  three  resistors  are  of  the  "base"  type  although  there 
is  some  difference  in  their  geometry.  Scatter  diagrams  for  resistor  2B 
versus  resistor  2A  and  resistor  2C  versus  resistor  2A  are  plotted  in 
Figures  4-3 (a)  and  4-3 (b),  respectively. 

The  approximate  slopes  of  the  linear  relationships  have  been  drawn 
on  the  scatter  diagrams.  The  scatter  diagrams  of  Figure  4-3  all  have 
unity  slopes  while  those  of  Figure  4-2  have  slopes  that  differ  greatly 
from  unity.  These  examples  show  that  it  is  possible  to  have  inter- 
related elements  on  an  integrated  circuit  which  have  non-unity  slopes. 
Also,  in  the  case  where  several  elements  are  fabricated  by  the  same 
technique,  one  can  expect  those  elements  to  be  related  with  a unity 
slope.  The  scatter  diagrams  from  which  the  slopes  are  determined  must 
be  plotted  using  normalized  values. 

Table  4-3  lists  the  correlation  coefficients,  the  slopes,  and  the 
ratios  of  the  normalized  standard  deviations  for  the  resistor  pairs  of 
Figures  4-2  and  4-3.  From  this  table  it  can  be  seen  that  the  ratio  of 
normalized  standard  deviations  is  close  to  the  value  of  the  slope  for 
those  resistor  pairs  for  which  the  correlation  coefficient  is  close  to 
1.0.  This  observation  indicates  that  there  exists  a constraint  on  the 
ratio  of  normalized  standard  deviations  for  a pair  of  correlated  ele- 
ments. It  is  easy  to  show,  for  the  case  of  perfect  correlation 
(|p^j|  = 1.0)  and  normal  distributions,  that  the  ratio  of  standard  de- 
viations must  be  exactly  equal  to  the  slope  magnitude. 


Normalized  values  of  resistor  1C  Normalized  values  of  resistor  IB 
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(a)  Resistor  IB  versus  resistor  lA. 
1.2 


Normalized  values  of  resistor  lA 
(b)  Resistor  1C  versus  resistor  lA 

Figure  4-2 


Scatter  diagrams  for  resistors  fabricated  with  different  techniques. 
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Table  4-2 

Experimental  values  of  normalized  resistance  for  three 
resistors  made  by  the  same  technique  on  the  same 
integrated  circuit. 


Chip 

Normalized  Resistance  Values 

Chip 

Normalized  Resistance  Values 

Resistor 

2A 

Resistor 

2B 

Resistor 

2C 

Resistor 

2A 

Resistor 

2B 

Resistor 

2C 

1 

0.9614 

0.9975 

0.9627 

17 

0.9313 

1.0102 

0.8805 

2 

0.9979 

1.0356 

0.9834 

18 

0.9742 

0.9371 

0.9602 

3 

1.0215 

0.9975 

1. 

0063 

19 

1.0043 

1.0102 

0,9963 

4 

0.9399 

0.9276 

0. 

9764 

20 

1.0472 

1.0229 

1.0648 

5 

0.9742 

0.9562 

0. 

9291 

21 

0.9528 

0.9117 

0.9042 

6 

1.0429 

1.0292 

0. 

9826 

22 

0.9828 

1.0261 

0.9988 

7 

0.9742 

0.9975 

1.0088 

23 

0.9270 

0.9085 

0.9091 

8 

1.0773 

1.0261 

1. 

0337 

24 

1.0472 

1.0546 

1,0561 

9 

0.9742 

0.9879 

0. 

9440 

25 

0.9142 

0.8958 

0.9104 

10 

0.9657 

0.9720 

0.9440 

26 

1.0086 

1.0038 

1.0648 

11 

0.9742 

0.9371 

0. 

9316 

27 

0.9442 

0.9435 

0.9166 

12 

0.9227 

0.9053 

0. 

9789 

28 

0.9742 

1.0070 

0.9752 

13 

1.0644 

1.1086 

1. 

0735 

29 

1.0987 

1.0229 

1.0661 

14 

1.0215 

1.0324 

1. 

0661 

30 

1.0987 

1.0737 

1.1059 

15 

1.1245 

1.1436 

1. 

1396 

31 

0.9871 

0.9572 

1.0088 

16 

0.9571 

0.9435 

0.8967 

32 

1.0215 

1,0070 

1.0088 

33 

1.0086 

0.9752 

1.0113 

34 

1.0901 

1.1053 

1.0935 

35 

0.9571 

1.0229 

0.9901 

36 

0.9657 

1.0038 

1.0113 

37 

1.0644 

1.0864 

1.0910 

38 

1.0386 

0.9975 

1.0561 

39 

0.9957 

1.0451 

1.0412 

40 

0.9742 

0.9562 

1.0212 

Mean 

Value 

233.00fi 

31.48f^ 

802. 95f^ 

Normalized 

Standard 

Deviation 

0.0535 

0.0576 

0.0638 
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(a)  Resistor  2B  versus  resistor  2A 


(b)  Resistor  2C  versus  resistor  2A 

Figure  4-3 


Scatter  diagrams  for  resistors  fabricated  with  the  same  technique. 


Table  4-3 


Comparison  of  standard  deviation  ratios  with  the  slope 
of  the  linear  relationship  for  correlated  resistors. 


Resistor 

pair 

Correlation 

coefficient 

Slope 

Ratio  of 

standard  deviations 

IB  vs.  lA 

0.9210 

0.555 

0.578 

1C  vs.  lA 

0.2005 

0.143 

0.388 

2B  vs.  2A 

0.7987 

1.0 

1.076 

2C  vs.  2A 

0.8323 

1.0 

1.192 
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As  stated  previously,  the  tolerance  of  a normal  distribution  can 

be  defined  as  a constant  times  its  standard  deviation.  If  we  have  two 

elements,  and  R2,  with  the  scatter  diagram  of  Figure  4-1 (a)  and  with 

normal  distributions  then  we  can  express  their  tolerances  as  AR,  = k a_ 

1 R 

and  AR„  = k a_  , where  k is  a constant.  Since  the  slope  of  the  linear 
2 

relationship  is  d^2  “ AR^/AR2,  then  the  standard  deviations  have  the 
relationship 


(4.2) 


or. 


(4.3) 


The  constraint  of  equation  (4.3)  is  only  strictly  true  in  the  case  of 
perfect  correlation.  A constraint  on  the  ratio  of  standard  deviations 
for  the  case  of  nonperfect  correlation  will  be  hypothesized  in  the  next 
section. 

4.3  Generation  of  Correlated  Normal  Distributions 

When  using  the  Monte  Carlo  method  for  computing  tolerances  of 
circuits  with  correlated  elements  it  has  generally  been  necessary  to 
obtain  correlated  element  distributions  by  means  of  experimental  mea- 
surements. If  the  Monte  Carlo  method  is  to  be  used  in  an  iterative 
tolerance  design  algorithm  it  will  not  always  be  possible  to  obtain 
measured  sets  of  element  values  that  have  the  desired  statistical  quan- 
tities. In  this  case  it  will  be  necessary  to  be  able  to  generate  sets 
of  distributions  having  practically  any  desired  standard  deviations, 
correlation  coefficients,  and  linear  relationships. 
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Cermak  and  Kirby  have  shown  how  two  correlated  random  variables, 
and  p^,  may  be  computed  [24].  They  have  introduced  the  expressions 

(4.4) 


and 


?2  = (1- 1^2  I ^^2  ^2^0  ’ 


(4.5) 


where  y^,  y^,  and  y^  are  noncorrelated  random  variables  having  mean 

values  m , m,  , and  m„  and  standard  deviations  a , a , and  a . A,  and 
0 12  >'2  1 

X2  are  tracking  coefficients  which  are  related  to  the  correlation  coef- 
ficient. However,  it  is  desirable  to  be  able  to  specify  correlation 
coefficients  and  the  slope  of  the  linear  relationship  between  elements, 
instead  of  tracking  coefficients,  when  generating  correlated  random 
variables. 

A method  for  generating  n correlated  random  variables,  p.*  is  to 
first  generate  n independent  random  variables,  which  have  zero  means 
and  unit  standard  deviations,  and  then  obtain  £ by  means  of  the  expres- 
sion £ = [A]£  + ^ , where  ^ is  the  vector  of  mean  values  of  £,  and  [A] 

is  a constant  n x n matrix  [25].  The  values  of  [A]  are  related  to  the 

T 

covariance  matrix  of  £ by  [A^]  = [A] [A]  , where  [A^]  is  the  covariance 
matrix  of  known  values.  If  [A]  is  of  upper  triangular  form  its  values 
are  easily  found  [26].  In  this  method  the  slopes  of  the  linear 
relationships  between  variables  are  not  specified,  but  are  assumed  to 
be  determined  by  the  standard  deviation  values,  as  in  equation  (4.3). 

It  can  be  shown  that,  for  nonperfect  correlation,  there  are  cases 
where  the  slope  does  not  obey  the  relationship  of  equation  (4.3). 

Assume  that  there  are  two  random  variables,  and  R2,  which  are 
linearly  related  by  R^^  = ^^2^2  ^12’ 


Also,  it  is  assumed  that  the 
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errors  in  the  P2  values  are  small  compared  to  the  errors  in  the  p^ 

values.  With  this  last  assumption  it  is  possible  to  obtain  an  accurate 

estimate  of  the  slope  by  means  of  the  method  of  least  squares  in  which 

the  sum  of  squares  of  deviations  parallel  to  the  axis  are  minimized. 

Referring  to  Figure  4-1  (b),  the  type  of  deviation  being  minimized  is 

seen  to  be  the  vertical  distance  from  a point  to  the  line.  It  is 

easily  shown  that  the  resulting  estimate  of  the  slope  is  given  by 

= Pi  /a  , which  is  different  from  d,„  = la  |/|a  I [271. 

12  ^12  p^  P2’  12  ' p^i  I p^i 

Based  on  the  small  amount  of  experimental  data  given  in  Tables  4-1 
and  4-2,  it  is  not  clear  whether  or  not  the  slope  should  be  specified 
when  generating  correlated  random  variables.  Under  the  assumption 
that  the  slope  is  an  important  quantity,  the  following  approximate 
method  for  generating  correlated  random  variables  is  presented. 

Sets  of  correlated  random  variables  may  be  generated  using  the 
expression 

p.  = (l-|X^|)y.  + + k.  , (4.6) 

where  y^  and  y^  are  independent  variables  with  mean  values  m and 

m.  and  standard  deviations  a and  a , k.  is  a constant,  v.  is  related 
i y y . ’ 1 ’ ' 1 

o 1 

to  the  slope  of  the  linear  relationship,  and  is  related  to  the  cor- 
relation coefficient.  The  expected  value  of  p^  is 

E(p^)  = (l-|X^l)m^  + + k^  , (4.7) 


and  its  variance  is 
2 


a = (1-|X. 1)^  + Y?|X  1^  0^ 

p.  'x'  y.  'I'i'  y 

"^i 


(4.8) 


For  the  purposes  of  this  method  we  assume  that  in  a set  of  corre- 


lated elements  the  (i)th  is  the  independent  element  and  that  all  of  the 
remaining  elements  in  the  set  are  dependent  on  it.  The  slopes  and 


^3 


correlation  coefficients  are  given  with  respect  to  i.  Assuming  that  we 
have  three  interdependent  elements,  i,  j,  and  k,  the  (j)th  and  (k)th 
elements  will  have  expressions  of  the  form  of  (4.6),  (4.7),  and  (4.8). 
The  correlation  coefficients  for  this  set  of  elements  are 


and 


Y.y.  A.  X.  a 
.1  1 ' J ' ' 1 ' y. 


a a 


(A. 9) 


"ki 


Vil^N^il^y 

_c 

o a 

Pk  Pi 


(4.10) 


The  relationship  between  the  slopes  and  y . , y.,  and  y will  now  bf 

1 J k 

derived.  In  the  case  where  we  have  perfect  correlation,  (i.e.. 


^ki' 


= Ip, .|  = 1.0),  the  distributions  are  related  by 


ji 


P.  = d, .p,  + b. . 
J Ji  i 


(4.11) 


and 


Pfc  “ '^kiPi  + hi  • 


(4.12) 


Since  IPj^l  1 i*0  ^nd  | Pj^^  | < i*0  for  all  cases,  we  will  also  constrain 

|X.|,  |X.|,  and  |X,  | to  be  equal  to  or  less  than  1.0.  When  we  have 
1 J K- 

perfect  correlation  the  values  of  |X.|,  |X.|,  and  |X,  | will  be  equal 

1 J k 

to  1.0,  in  which  case  equation  (4.6)  and  its  like  equations  become 

\ , (4.13) 


p.  = y.y  + k.  , 

J JO  J 


(4.14) 


and 


Pk  ■ + h 


(4.15) 


By  solving  equation  (4.13)  for  y^  and  then  substituting  into  (4.14)  and 
(4.15)  we  obtain 
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Y-  Y.k. 

p.  = -Ip.  _ -XJL+  k. 
J Yi  Yi  j 


(4.16) 


and 


Y, 


Yi,k. 

k 1 


p,  = — p . 1-  k 

*^k  Y.  1 Y. 

' 1 ' 1 


k ’ 


(4.17) 


which  are  of  the  form  of  equations  (4.11)  and  (4.12).  Thus,  letting 


Y^  = 1.0,  we  see  that 

Y.  = d.  . 

J Ji 


(4.18) 


and 


■ ‘‘ki  • 


(4.19) 


With  the  relationships  of  equations  (4.18)  and  (4.19)  the  equations  of 
the  form  of  (4.6)  and  (4.8)  now  become 


and 


t'l  1 fl  J'i  I il-'o 

Pw  = + ‘^kil^lyo  ’ 


'k 

= (1-|X. 1)^  + |A. I 

P . 1 y . ' 1 ' 


= (1-|X. 1)^  + d?. |A. 

Pj  ' J ' Yj  Ji'  J 


af  = (1-U, J)^  a?,  + d?,  lx 


ki , 

(4.20) 

, + ^ « 

(4.21) 

1 ^k  ’ 

(4.22) 

: 2 

0 , 

v 

(4.23) 

^o 

|2  2 

• a , 

j'  y^  ’ 

(4.24) 

|2 

k'  y 

•'  n 

(4.25) 

A further  simplification  of  equations  (4.20)  through  (4.22)  results 

if  we  cause  the  mean  values  of  y^,  y^,  y^  , and  y^^  to  be  equal  to  zero. 

Thus , if  we  have  normalized  values  of  p . , p . , and  p,  , the  mean  values 

1 J ‘^k 

of  the  p's  and,  hence,  the  values  of  the  k's  will  equal  1.0. 
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We  now  must  determine  the  standard  deviations  0,0,  and  O 

and  the  coefficients  1A.|,  |A.|,  and  |A  |.  Equations  (4.23)  through 

1 J k 

(4.25)  can  be  solved  for  the  0^'s,  which  are 


2 H |2  2 

a - X . a 

o P-  i'  y 

2 1 ■'o 


a 


^i 


(4.26) 


2 ^2  |.  |2  2 
O -d . . X . 0 

2 Pj  J yp 
~ (i-|Aj)'  ’ 


(4.27) 


and 


2 j2  |,  ,2  2 

a -d,  . X,  a 
p,  ki ' k ' y 
k ^ 


(4.28) 


Since  the  variance  is  a nonnegative  quantity  the  following  constraints 
must  be  used. 


2 i-v  |2  2 

a > X.  a 
p.  - ' i'  y 

o 


(4.29) 


a > d.. 

Pj  - ' 


|2  K |2  2 

X.  a 

j ' y. 


(4.30) 


2 I,  |2  |2  2 

a > d,  J X,  a 

p,  - ' ki'  ' k'  y^ 


(4.31) 


If  we  solve  equations  (4.9)  and  (4.10)  for  o we  obtain 

^o 

Ip.  . Icr  a 

9 ' Pj  Pj 


X J X.. 


Ji' 


(4.32) 


and 


p,  . a a 

2 Pk  Pj 

\ ' KiTT^JfhJ  • 


(4.33) 


Substituting  (4.32)  into  (4.29)  and  (4.33)  into  (4.29)  produces 
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P. . X.  a o 

ji ' ' 1 ' p p 


°p.  idTnrh^ 


(4.34) 


and 


Pi 


(4.35) 


from  which  we  can  obtain  the  constraints 


I O d.. 
P . J 1 

i'  ^ 


XI  - a p.. 
j ' P j J ^ 


(4.36) 


and 


|X,|  \'^kil 

< 


X.  - o p.TT  ■ 

' k p ' ki ' 

k 


(4.37) 


Similarly,  by  the  substitution  of  (4.32)  into  (4.30)  and  (4.33)  into 
(4.31)  we  obtain  the  constraints 


d.  . p.  . a 
' p, 


IXjl- 


(4.38) 


and 


ra"- 


l''iciNfkil“p. 

1 


(4.39) 


By  equating  (4.32)  and  (4.33)  we  have  the  following  relationship  between 
lx,  I and  |A,  | , 


d,  . p,  . a X. 

' j 1 ' ' ki ' pj^  I j 

|d,  . I I p. . |a 

' ki ' ' ' p . 


(4.40) 


Finally,  by  combining  equations  (4.36)  with  (4.38),  combining  (4.37) 
with  (4.39),  and  substituting  for  |Xj^|  by  means  of  (4.40)  we  are  left 
with  a set  of  constraints  on  the  ratio  jX^|/jX.|. 
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d. . p.,  a 

' j 1 ' ' i ' p 


" <4^< 


d. . a 

' Ji'  P, 


- A.  - p..  a 

' J ' J ^ P j 


(4.41) 


Pi-  I d..a 

' ki'  ' ji'  |X^|  ' ji'  P^ 


P.  . P 
' Ji'  Pj 


- 


p. . a 
ix'  Pj 


(4.42) 


When  choosing  values  for  |X^|  and  |Xj | we  must  ensure  that  the  ratio 
constraints  of  equations  (4.41)  and  (4.42)  are  met  and  that  the  values 

of  |A.|,  1A.|,  and  |A,  | are  between  0.0  and  1.0. 

X J K 

The  equations  derived  thus  far  are  too  general  to  obtain  a set  of 
constraints  on  the  standard  deviations  or  their  ratios.  In  order  to 
produce  such  constraints  we  can  set  the  values  of  |Aj^|  and  [A^  | equal 
to  the  square  root  of  the  magnitude  of  the  largest  correlation  coeffi- 
cient in  the  set.  Assuming  that  the  (i,j)th  correlation  coefficient  is 
largest,  we  have 


l\l  ■ |Ajl  - >T^ 


(4.43) 


Now  the  ratio  |A^]/|A^|  is  equal  to  1.0  so  we  can  extract  the  following 
constraint  from  equation  (4.41). 

a 


p.  d.. 

d ||p  I < — ^ < T ^1 

Ji"  - IPjil 


(4.44) 


Since  all  of  the  specified  correlation  coefficients  have  a magnitude 
that  does  not  exceed  unity  we  know  that  [A^|  and  |Aj|  will  not  exceed 
unity.  In  order  that  |Aj^|  also  does  not  exceed  unity  we  can  derive  the 
following  constraint  from  equation  (4.40). 
a 


°p.  - i<*jiii‘’kii 
1 


(4.45) 


48 


It  is  hypothesized,  but  not  proved,  that  all  element  standard 
deviations  for  a set  of  correlated  elements  are  constrained  by 

• 1 

TTl  ‘ Tm  I 

(4.46) 


p M . 
d , P,  .1  < — < 


mx ' ' ml ' - a - 0 . 

p . ' mi ' 

1 

The  above  constraints,  have  been  tested  using  the  experimental  data  from 
Tables  4-1,  4-2,  and  4-3.  The  results,  which  are  tabulated  in  Table 
4-4,  show  no  case  for  which  the  constraint  limits  are  exceeded.  It  is 
not  the  purpose  of  this  research  to  prove  that  equations  (4.45)  and 
(4.46)  are  valid  in  all  cases.  However,  based  on  a small  number  of 
experimental  cases,  it  appears  that  the  constraints  are  reasonable. 

The  above  derivation  is  for  the  case  of  three  correlated  elements, 
but  the  results  are  valid  for  any  number  of  correlated  elements.  All 
terms  in  the  above  equations  which  apply  to  the  (k)th  element  also 
apply  to  the  (n)th  element. 

A method  for  the  generation  of  an  arbitrary  number  of  correlated 
random  distributions  proceeds  according  to  the  following  steps: 

(1)  Test  the  ratios  of  normalized  standard  deviations  using  equa- 
tions (4.45)  and  (4.46).  If  the  constraint  limits  are  not  exceeded 
then  go  on  to  step  (2); 

(2)  Select  the  correlation  coefficient  with  the  largest  magnitude 

and  call  it  Let  |X^|  = |Xj|  = /jp^; 

(3)  Calculate  the  remaining  |Xj^|  coefficients  using  equation  (4.40) 

(4)  Calculate  a using  equation  (4.32); 

^o 

(5)  Calculate  the  values  of  a , a , a , . . . using  equations 


y.  yi 


(4.26)  through  (4.28); 


(6)  Generate  normal  distributions  for  y^,  y^,  y^,  . . . using  a 
random  number  generating  subroutine; 


Test  of  standard  deviation  ratio  constraints  using 
experimental  data. 
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(7)  Compute  the  values  of  p.,  p.,  p , . . . using  equations  (4.20) 

X i K. 

through  (4.22). 

The  above  procedure  has  been  programmed  and  tested  by  attempting 
to  simulate  the  distributions  of  the  two  sets  of  resistors  of  Tables 
4-1  and  4-2.  The  sets  of  element  values  produced  by  this  program  and 
their  standard  deviations  are  listed  in  Tables  4-5  and  4-6.  The  re- 
sulting scatter  diagrams  are  plotted  in  Figures  4-4  and  4-5.  Table  4-7 
gives  a comparison  of  the  statistical  quantities  of  the  experimental 
and  simulated  resistor  values.  The  standard  deviation  values  differ  by 
less  than  10.0  and  the  correlation  coefficients  by  less  than  5.0%. 
Closer  agreement  of  the  statistical  quantities  can  be  had  by  using  a 
larger  sample  size.  If  the  various  scatter  diagrams  are  compared  it  is 
very  difficult  to  determine  which  are  plotted  from  experimental  data 
and  which  are  plotted  from  simulated  data.  The  most  obvious  difference 
is  between  Figures  4-2 (a)  and  4-4  (a)  because  in  the  latter  diagram  the 
points  are  nicely  spread. out  but  in  the  former  most  points  are  clustered 
at  one  end. 

As  stated  previously,  the  method  for  generating  correlated  random 

variables  just  presented  is  an  approximate  one.  To  obtain  a set  of  n 

correlated  variables  we  need  only  specify  n-1  slope  values,  n-1  correla- 

2 

tion  coefficients,  and  n standard  deviations,  which  leaves  (n  -3n+2)/2 
correlation  coefficients  unspecified.  However,  if  the  correlation  co- 
efficients are  large  (close  to  1.0)  the  simulation  will  be  quite  accu- 
rate, as  can  be  seen  in  Table  4-8.  Table  4-8  lists  the  results  of  a 
simulation  of  three  correlated  random  variables  all  of  which  are  assumed 
to  be  related  by  a slope  of  unity.  Even  though  the  correlation  coeffi- 
cient between  variables  2 and  3 was  unspecified,  the  value  of  that 
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correlation  coefficient  produced  by  the  simulation  is  quite  close  to 


the  desired  value. 
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Table  4-5 

Normalized  resistance  values  produced  by  simulation  of 
resistors  of  Table  4-1. 


Chip 

Normalized  Resistance  Values 

Chip 

Normalized  Resistance  Values 

Resistor 

lA 

Resistor 

IB 

Resistor 

1C 

Resistor 

lA 

Resistor 

IB 

Resistor 

1C 

1 

0.9113 

0.9932 

1. 

0565 

17 

1.0494 

1.0303 

1.0113 

2 

1.0482 

1.0412 

1. 

0116 

18 

0.9535 

1.0702 

1.0269 

3 

0.9477 

0.9561 

1.0772 

19 

0.8588 

0.9021 

1.1035 

4 

0.8606 

0.8800 

0.8694 

20 

0.9859 

0.9427 

0.9512 

5 

1.0574 

1.0387 

0.9847 

21 

0.9229 

0.8953 

0.8901 

6 

1.1228 

1.0884 

1. 

0351 

22 

1.1378 

1.0752 

0.9603 

7 

1.0552 

1.0420 

1. 

0471 

23 

1.0944 

1.0569 

1.0201 

8 

1.2560 

1.1354 

1. 

0842 

24 

1.0603 

1.0633 

1.0218 

9 

1.0424 

0.9920 

1. 

0765 

25 

0.8987 

0.9346 

1.0536 

10 

1.0664 

0.9909 

1. 

0636 

26 

1.2045 

1.1328 

1.0376 

11 

1.1402 

1.0710 

1. 

0746 

27 

1.0285 

1.0182 

1.0073 

12 

1.2138 

1.1361 

1. 

0334 

28 

1.0964 

1.0552 

0.9639 

13 

1.0150 

1.0486 

0.9187 

29 

1.1606 

1.0659 

0.9236 

14 

0.7578 

0.8887 

1. 

0130 

30 

1.0731 

1.0309 

1.0176 

15 

0.9493 

0.9873 

1. 

0035 

31 

0.9304 

0.8946 

1.0196 

16 

0.9415 

0.9520 

0.9778 

32 

0.8509 

0.9125 

1.0131 

33 

1.0392 

1.0233 

0.9556 

34 

1.0207 

1.0135 

1.0012 

35 

0.7736 

0.8387 

1.0281 

36 

0.9800 

0.9629 

0.9443 

37 

1.0809 

1.0768 

0.9374 

38 

0.8144 

0.9137 

0.9522 

39 

1.1393 

1.0845 

0.9858 

40 

1.2100 

1.0923 

1.1131 

0 

Normalized 

Standard 

Deviation 

0.13141 

0.07747 

0.05273 

a 


standard  deviation  calculations  based  on  a sample  size  of  300. 
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Table  4-6 

Normalized  resistance  values  produced  by  simulation  of 
resistors  of  Table  4-2. 


Chip 

Normalized  Resistance  Values 

Chip 

Normalized  Resistance  Values 

Resistor 

2A 

Resistor 

2B 

Resistor 

2C 

Resistor 

2A 

Resistor 

2B 

Resistor 

2C 

1 

0.9647 

1.0202 

1. 

0138 

17 

1.0232 

1.0203 

1.0294 

2 

1.0172 

1.0448 

1. 

0209 

18 

0.9887 

1.1025 

1.0160 

3 

0.9770 

0.9595 

1. 

0375 

19 

0.9304 

0.9317 

1.0117 

4 

0.9384 

0.8885 

0.8493 

20 

0.9866 

0.9368 

0.9475 

5 

1.0183 

1.0422 

1.0000 

21 

0.9741 

0.8715 

0.9011 

6 

1.0579 

1.0682 

1. 

0787 

22 

1.0523 

1.0632 

1.0104 

7 

1.0205 

1.0426 

1. 

0503 

23 

1.0449 

1.0363 

1.0561 

8 

1.1161 

1.0810 

1. 

1654 

24 

1.0272 

1.0633 

1.0402 

9 

1.0031 

0.9966 

1. 

0496 

25 

0.9450 

0.9657 

0.9855 

10 

1.0263 

0.9652 

1.0681 

26 

1.0950 

1.0957 

1.1134 

11 

1.0653 

1.0373 

1. 

1143 

27 

1.0147 

1.0105 

1.0196 

12 

1.0953 

1.1027 

1. 

1081 

28 

1.0425 

1.0384 

1.0100 

13 

1.0035 

1.0670 

0. 

9406 

29 

1.0649 

1.0369 

0.9958 

14 

0.9052 

0.9228 

0.9351 

30 

1.0235 

1.0277 

1.0279 

15 

0.9805 

0.9980 

0. 

9876 

31 

0.9667 

0.8847 

0.9839 

16 

0.9783 

0.9498 

0.9673 

32 

0.9361 

0.9347 

0.9555 

33 

1.0230 

1.0077 

0.9906 

34 

1.0191 

0.9947 

1.0239 

35 

0.9056 

0.8569 

0.9425 

36 

0.9881 

0.9610 

0.9463 

37 

1.0353 

1.0755 

0.9839 

38 

0.9180 

0.9544 

0.8932 

39 

1.0665 

1.0539 

1.0505 

40 

1.0852 

1.0563 

1.1531 

Normalized^ 

Standard 

Deviation 

0.05690 

0.06143 

0.06876 

standard  deviation  calculations  based  on  a sample  size  of  300. 


Normalized  value  of  resistor  1C  Normalized  value  of  resistor  IB 
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Normalized  value  of  resistor  lA 
(a)  Resistor  IB  versus  resistor  lA. 


(b)  Resistor  1C  versus  resistor  lA. 

Figure  4-4 

Scatter  diagrams  for  simulated  resistor  of  Table  4-5. 
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(a)  Resistor  2B  versus  2A 


(b)  Resistor  2C  versus  resistor  2A 

Figure  4-5 

Scatter  diagrams  for  simulated  resistors  of  Table  4-6. 


simulated  resistor 
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Table  4-8 


Comparison  of  desired  and  simulated  statistical  quantities 
to  show  accuracy  of  method. 


(a) 


Variable 

Desired 

Standard 

Deviation 

Simulated* 

Standard 

Deviation 

1 

0.08 

0.08202 

2 

0.08 

0.07646 

3 

0.08 

0.07825 

(b) 


Element 

Pair 

Desired 

Correlation 

Coefficient 

Simulated* 

Correlation 

Coefficient 

1-2 

0.9 

0.9015 

1-3 

0.9 

0.9058 

2-3 

0.9** 

0.8878 

* Based  on  sample  size  of  200. 

**Unspecif ied  in  method  of  generating 
correlated  random  variables. 


CHAPTER  5 


A COMPUTER-AIDED  TOLERANCE  DESIGN  ALGORITHM  FOR 
CONTINUOUS  TOLERANCES 

When  designing  tolerances  for  circuit  elements  there  are  two  basic 
situations  that  can  be  encountered.  First,  the  element  tolerances  may 
be  continuous  variables  and  can  assume  any  value  within  a certain 
range.  This  situation  arises  in  integrated  circuits.  The  second  situ- 
ation is  where  the  element  tolerances  are  discrete  variables  and  may 
assume  only  a finite  number  of  fixed  values.  For  example,  the  elements 
of  a discrete  circuit  may  have  standard  tolerance  values,  such  as  5, 

10  , or  20%.  The  continuous  and  discrete  tolerance  cases  present 
drastically  different  problems  when  attempting  to  formulate  an  algo- 
rithm for  automatic  tolerance  design.  Discussion  of  the  discrete  tol- 
erance case  will  be  postponed  until  Chapter  6. 

5. 1 General  Description  of  Algorithm 

This  chapter  presents  a new  iterative  algorithm  for  computer-aided 
tolerance  design  in  the  frequency  domain.  The  algorithm  is  for  the 
continuous  tolerance  case  and  allows  the  designer  to  obtain  a specified 
circuit  yield  using  any  type  of  element  value  distribution.  The  main 
new  features  of  this  algorithm  are  that  the  Monte  Carlo  method  is  used 
in  the  main  iteration  loop  and  that  the  Monte  Carlo  analysis  takes 
into  account  the  correlation  between  circuit  elements.  The  frequent 
use  of  Monte  Carlo  analysis  is  made  less  economically  objectionable  by 
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having  a variable  sample  size;  the  sample  size  remains  small  until  the 
algorithm  nears  convergence,  at  which  time  the  sample  size  is  increased 
to  obtain  more  accuracy.  By  using  the  method  for  generating  correlated 
distributions  that  was  presented  in  Chapter  4,  the  Monte  Carlo  method 
can  take  into  consideration  linear  interdependence  between  elements. 

The  dependence  on  the  Monte  Carlo  analysis  method  is  justified  by 
the  fact  that  it  is  the  most  dependable  of  the  tolerance  analysis  methods. 
As  a matter  of  fact,  in  all  of  the  computerized  tolerance  design  algo- 
rithms which  were  described  in  Chapter  3,  a Monte  Carlo  analysis  is  per- 
formed to  verify  the  results. 

In  the  tolerance  design  algorithm  presented  here  we  attempt  to 
determine  the  set  of  element  tolerances  that  is  least  costly  and  that 
produces  a specified  circuit  yield,  or  percentage  of  circuits  having  all 
responses  within  the  response  limits.  Since  there  is  some  uncertainty 
in  Monte  Carlo  results  (a  characteristic  of  statistical  sampling)  the 
goal  of  the  algorithm  is  to  produce  a circuit  yield  that  falls  within 
a specified  range  about  the  desired  yield.  In  the  case  where  a 100% 
yield  is  desired,  a measure  other  than  yield  is  used  as  a basis  for 
tolerance  design.  The  new  measure,  the  maximum  response  spread,  tells 
if  the  element  tolerances  are  overdesigned  when  the  yield  is  100%.  For 
example,  if  element  tolerances  of  10%  produce  a 100%  yield,  then  any 
smaller  tolerances  will  produce  the  same  yield. 

The  nominal  response  value  at  the  (i)th  frequency  is  denoted  by 
while  the  upper  and  lower  response  limits  are  denoted  by  and  A^, 
respectively.  The  Monte  Carlo  responses  having  the  largest  and  smallest 
values  at  the  (i)th  frequency  are  A^  and  A^  , respectively.  Thus,  the 

S a S • 

1 1 

maximum  response  spread  for  the  (i)th  frequency  is  defined  to  be 
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A^  -A. 
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> 
• 1 
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> 

A. -A. 

1 1 

1 1 

(5.1) 


and  is  the  largest  response  tolerance  above  or  belov/  the  nominal  re- 
sponse value.  The  overall  maximum  response  spread  is  defined  as 

— max(Sj^,  ^2’  • • •♦  ’ (5.2) 


where  m is  the  number  of  frequencies.  is  simply  equal  to  the  largest 

of  the  individual  frequency  maximum  response  spreads. 

A simplified  flow  diagram  of  the  computer-aided  tolerance  design 
algorithm  is  shown  in  Figure  5-1.  The  algorithm  proceeds  according  to 
the  following  steps. 

(1)  Estimate  the  desired  circuit  cost  and  estimate  the  desired  re- 
sponse tolerances,  or  variances,  from  the  design  specifications. 

(2)  Minimize  the  objective  function  to  obtain  an  approximate  set 
of  element  tolerances  that  will  produce  the  desired  response  tolerances 
and  circuit  cost. 

(3)  Perform  a Monte  Carlo  analysis  using  the  element  tolerance  set 
from  step  (2).  Calculate  the  yield  and  maximum  response  spread. 

(4)  Test  to  see  if  the  yield  or  maximum  response  spread  is  within 
the  desired  range.  If  it  is  within  range,  the  algorithm  has  converged; 
if  not,  go  to  step  (5). 

(5)  If  the  desired  yield  or  maximum  response  spread  is  between 
the  values  for  the  current  and  last  previous  tolerance  sets,  go  to 
step  (7);  if  not,  go  to  step  (6). 

(6)  Alter  the  desired  response  variances  and  the  desired  circuit 
cost  in  order  to  achieve  the  desired  yield  or  maximum  response  spread, 
then  go  to  step  (2). 
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Figure  5-1 

Simplified  flow  diagram  of  the  continuous  tolerance  design 
algorithm. 


62 


(7)  Linear  interpolate  between  the  two  tolerance  sets  to  obtain  a 
new  tolerance  set  that  will  produce  the  desired  yield  or  maximum  re- 
sponse spread. 

(8)  Perform  a Monte  Carlo  analysis  using  the  element  tolerance  set 
from  step  (7).  Calculate  the  yield  and  maximum  response  spread. 

(9)  If  the  yield  or  maximum  response  spread  is  within  the  desired 
range  the  algorithm  has  converged;  if  not,  eliminate  the  tolerance  set 
which  has  the  yield  or  maximum  response  spread  that  is  farthest  from 
the  desired  value  and  return  to  step  (7). 

The  purpose  of  the  linear  interpolation  is  to  compensate  for  too 
large  a step  by  means  of  a linear  approximation. 


5. 2 The  Objective  Function 

The  objective  function,  e,  used  in  this  algorithm  consists  of  two 
parts.  One  part,  relates  the  element  standard  deviations  to  the 

response  variances.  The  second  part,  relates  the  element  tolerances 

to  the  circuit  cost.  The  objective  function  is 

e = + 02  > (5.3) 

where 


m 


£2  = ^wc' 


n 


I c. 

•1  1 

(x=l  j 


- 


(5.4) 


(5.5) 


and  where  WR^  and  WC  are  real,  nonnegative  weights,  is  the  circuit 

response  magnitude  at  frequency  k (referred  to  hereafter  simply  as  the 

.2 


circuit  response),  O is  the  normalized  variance  of  A^,  5^  is  the 


desired  value  of  a.  , c.  is  the  cost  of  circuit  element  i,  c„  is  the 
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desired  cost  of  the  entire  circuit,  m is  the  number  of  frequencies,  and 

n is  the  number  of  circuit  elements.  The  values  of  are  initially 

estimated  from  the  response  tolerance  specifications.  a.  is  calcu- 

\ 

lated  using  a form  of  the  propagation  of  variance  equation  in  which 
only  second  and  lower  order  terms  are  present: 

ol  = 5^[X.  ]d  , (5.6) 

where  a = (a  , a , a ) is  the  vector  of  n normalized  circuit 

-T  Pi  P2  Pn 

element  standard  deviations  and  [X^^]  is  a symmetric  nxn  matrix.  The 


(i,j)th  element  of  [X^]  has  the  form 


’■kij  ' ou 


/S 

A,  9p. 
k 


\ 


(5.7) 


and  is  evaluated  using  nominal  values.  is  the  linear  correlation 

coefficient  between  elements  i and  j.  Since  equation  (5.6)  is  exact  in 

~2 

only  a few  special  cases,  the  values  of  a.  are  approximate. 

The  second  term  of  equation  (5.3)  is  a cost  function,  which,  when 
minimized,  causes  the  actual  circuit  cost  to  approach  the  desired  cost. 
The  cost  of  element  i is  obtained  from  the  relationship 


t. 

1 


(5.8) 


where  t^  is  the  percent  tolerance  of  element  i and  is  a cost  factor 
that  depends  on  the  element  type.  When  normal  element  distributions 
are  used  we  assume  that 


The  nominal  responses  are  those  produced  by  a circuit  with  elements  aj.1 
at  their  nominal,  or  design,  values.  A nominal  value  is  indicated  by  A^, 
an  actual  value  by  A^,  a mean  value  by  and  a normalized  value  by 

Thus,  if_we  have  a set  of  responses  A{^^,  Aj^^*  • • •>  mean  value 

will  be  A^.  If  each  member  of  the  set  is  divided  by  A^  we  have  the 
normalized  set,  Aj^^,  Aj^2»  • • •>  ^kjjj’  normalized  set  has  a mean 

value  of  1.0. 
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t.  = 300  a 


(5.9) 


1 


For  nonnormal  distributions  other  relationships  between  tolerance  and 
standard  deviation  must  be  used. 

The  cost  equation,  (5.8),  is  similar  to  the  formulas  used  in  other 
tolerance  design  algorithms  [15,17,18].  By  using  the  proper  cost  factor 
equation  (5.8)  can  quite  accurately  approximate  the  element  cost.  Some 
suitable  cost  factor  ranges  for  discrete  elements  are  0.5  to  0.75  for 
resistors,  2.0  to  3.0  for  capacitors,  and  5.0  to  10.0  for  inductors. 
These  values  were  estimated  using  typical  costs  from  a retail,  mail- 
order electronics  supply  catalog. 

The  purpose  of  term  of  the  objective  function  is  to  reduce  the 
circuit  cost  to  a value  less  than  c^^.  If  the  objective  function  con- 
sisted only  of  then  element  standard  deviations  would  assume  any  nec- 
essary values  to  produce  the  desired  response  variances.  Thus,  finding 
a minimum  of  equation  (5.3)  usually  results  in  a compromise  between 
attaining  the  desired  response  variances  and  attaining  the  desired  min- 
imum circuit  cost.  This  compromise  can  be  affected  by  the  suitable 
choice  of  weights  WR^  and  WC.  Term  ^2  excluded  from  e when  c < c^. 

The  objective  function  can  be  minimized  by  use  of  a gradient  opti- 
mization method.  Gradient  optimization  methods  are  briefly  described 
in  Appendix  B.  The  gradient  vector  of  equation  (5.3)  is 


(5.10) 


where  [D]  is  an  n x n matrix  having  elements  of  the  form 
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9a 


(5.11) 


9a 


and  z is  the  vector 


T 

z = 


Pi 


ai 


a 


32  ’ 52  ’ ‘ o2 

Pi  P2  Pi 


(5.12) 


The  (-&)th  term  of  the  gradient  vector  is 
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= 2 WRf 


9a 
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(5.13) 


where 


, P 

-k  _ Is  k 


(5.14) 


\ 3P. 


If  we  assume  that  no  two  circuit  elements  will  be  perfectly  correlated 
then  equation  (5.13)  reduces  to 

n 

I 

S = 1 


— = 2 I WrJ 

95  k=l  ^ 


P^ 


-2  ~2 

V"^i 


I Ps£  ^S  -p 


WC 

300 


95 
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I c. 


i=l 


- 


\ 

~2 

[^4 

(5.15) 


because  = 0 for  s ^ t.  The  correlation  coefficient  terms  will  take 

oO 


P£ 
Luei 

uncorrelated. 


on  the  values  = 1.0  for  s = Z and  = 0.0  if  elements  s and  Z are 


5. 3 Details  of  the  Algorithm 

Further  details  of  the  simplified  flow  diagram  of  Figure  5-1  are 


given  in  Figures  5-2  through  5-5.  Figure  5-2  illustrates  the  program 
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Figure  5-2 


Detailed  flow  diagram  of  segment  5-2  of  Figure  5-1. 
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flow  through  the  objective  function  minimization  and  Monte  Carlo  analy- 
sis portions  of  the  algorithm. 

At  the  beginning  of  the  algorithm  many  data,  in  addition  to  the 
desired  circuit  cost  and  the  desired  response  variances,  must  be  ini- 
tialized or  read  into  the  program.  It  is  assumed  that  the  circuit  has 
been  designed  to  meet  the  specified  nominal  response  values  and  that, 
hence,  the  nominal  circuit  element  values  have  been  selected.  The  in- 
put data  include  (a)  the  circuit  topology  and  nominal  element  values, 
(b)  the  frequencies  of  interest,  (c)  the  desired  yield,  the  allowable 
yield  range,  and  the  allowed  range  of  the  maximum  response  spread,  (d) 
the  upper  and  lower  limits  for  the  responses,  for  the  response  vari- 
ances, and  for  the  element  standard  deviations,  (e)  the  slopes  and 
correlation  coefficients  for  correlated  element  pairs,  (f)  the  response 
weights,  the  cost  weight,  and  the  element  cost  factors,  (g)  the  maximum 
number  of  iterations,  and  (h)  a seed  integer  for  the  random  number 
generator . 

Before  starting  the  minimization  step  it  is  necessary  to  compute 
the  network  sensitivities  that  are  used  in  the  objective  function. 

The  sensitivities  are  computed  using  the  adjoint  network  technique  [13]. 
The  objective  function  is  minimized  using  one  of  the  efficient  gradient- 
type  optimization  methods  such  as  Fletcher-Powell , Conjugate  Gradient, 
Davidon's  Variance  Algorithm,  or  the  Jacobson-Oksman  Algorithm 
[28,29,30,31].  Normalized  standard  deviation  values  are  used  to  in- 
crease the  efficiency  of  the  optimization.  If  there  are  correlated  el- 
ements the  element  standard  deviation  values  for  a correlated  set  are 
limited  by  the  standard  deviation  ratio  constraints  of  equations  (4.44), 
(4.45),  and  (4.46).  Once  the  standard  deviation  of  the  independent 
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element  is  fixed  the  remaining  standard  deviations  in  that  correlated 
set  must  not  exceed  the  limits  of  these  ratio  constraints. 

After  the  Monte  Carlo  analysis  is  performed  it  is  necessary  to 
calculate  the  overall  and  individual  frequency  yields  as  well  as  the 
overall  and  individual  maximum  response  spreads.  The  individual  fre- 
quency yield  is  defined  as  the  percentage  of  response  values  that  are 
within  the  response  limits  at  the  frequency  in  question.  The  overall 
yield  is  the  percentage  of  circuits  (actually  the  percentage  of  re- 
sponse sets)  for  which  all  response  values  are  within  the  limits  at  all 
frequency  points.  The  maximum  response  spreads  are  calculated  according 
to  equations  (5.1)  and  (5.2). 

Since  the  uncertainty  in  the  Monte  Carlo  results  is  larger  for 
smaller  sample  sizes,  the  allowed  yield  range  is  increased  for  small 
sample  sizes.  If  the  specified  yield  range  is  ± AY,  then  for  a 
sample  size  of  100  a range  of  ±2AY  is  used  and  for  a sample  size  of  20 
a range  of  ±3AY  is  used.  The  amount  of  uncertainty  that  can  be  expected 
in  this  application  has  been  experimentally  determined  and  is  presented 
in  Appendix  C. 

Figure  5-3  shows  the  segment  of  the  algorithm  that  tests  to  see  if 
the  algorithm  has  reached  the  stage  where  linear  interpolation  is  nec- 
essary. At  this  point  the  goal  is  to  have  two  sets  of  element  toler- 
ances (the  current  set.  A,  and  the  previous  set,  B)  that  produce  yields 
or  maximum  response  spreads  which  are  above  and  below  the  desired  value. 
Before  linear  interpolation  can  begin  , tolerance  sets  A and  B 
must  have  had  Monte  Carlo  analyses  at  a sample  size  of 
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Figure  5-3 


Detailed  flow  diagram  of  segment  5-3  of  Figure  5-1. 
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300.  If  the  yields  or  maximum  response  spreads  are  both  above  or  both 
below  the  desired  value  the  flow  of  the  algorithm  passes  to  Figure  5-4. 

Figure  5-4  illustrates  the  portion  of  the  flow  diagram  during 
which  the  desired  circuit  cost,  the  desired  response  variances,  and  the 
response  weights  are  changed.  If  the  circuit  yield  is  too  large  or  the 
maximum  response  spread  is  too  small  then  we  must  increase  the  desired 
response  variance  and  decrease  the  desired  circuit  cost.  The  desired 
response  variance  is  increased  at  every  frequency  by 

5^  (new)  - (^)(|-)  (old)  (5.16) 

1 Ml 


or 


1 D i 


(5.17) 


depending  on  whether  the  maximum  response  spread  or  the  yield  is  being 
used  as  a design  measure.  is  the  overall  maximum  response  spread, 

Yjj  is  the  desired  circuit  yield,  and  is  the  individual  yield  for 
frequency  1.  If  the  actual  circuit  yield  is  too  small  or  the  maximum 
response  spread  is  too  large  then  we  must  increase  the  desired  circuit 
cost.  We  must  also  decrease  the  desired  response  variances  at  those 
frequencies  for  which  the  individual  yield  is  below  the  allowed  range 
or  at  which  the  maximum  response  spread  is  greater  than  the  minimum 
allowed.  The  equations  according  to  which  the  variance  is  changed  are 


2 

5^  (new)  = (0.8)  (|-)  5^  (old) 
i Mi 


(5.18) 


or 


(new)  = (0.8)  (:^)  (old) 


AD. 
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D 


AD. 

1 


(5.19) 
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If  ISM  = 20,  k.  = 0.94  and  k_  = 1.06. 

If  ISM  = 100,  k.  = 0.96  and  k.  = 1.04. 

If  ISM  = 300,  k.  = 0.98  and  k„  = 1.02. 
’ 1 2 


Figure  5-4 


Detailed  flow  diagram  of  segment  5-4  of  Figure  5-1 
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The  factor  0.8  in  equations  (5.16)  through  (5.19)  has  been  found  to 
speed  up  the  algorithm  considerably  without  causing  any  adverse  effects. 

Figure  5-5  shows  the  segment  of  the  flow  diagram  in  which  linear 
interpolation  takes  place.  A new  set  of  element  standard  deviations  is 
computed  as 


or 


o 


P^i  *^pB^ 


Pi 


Y -Y 
A B 


+ 5pA, 


(5.20) 
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pA.  '^pB. 
^ 1 1 


1.0+S 


D . 
min  _ 

2 M 


+ a 


B 


pAi  • 


(5.21) 


where  subscript  A denotes  tolerance  set  A,  subscript  B denotes  tolerance 

set  B,  Yp  is  the  desired  yield,  and  is  the  smallest  acceptable 

min 

value  of  the  maximum  response  spread. 


5. A Examples 

The  continuous  tolerance  design  algorithm,  as  presented  above,  has 
been  used  successfully  on  several  circuits.  To  illustrate  the  use  of 
the  algorithm,  the  results  of  three  example  solutions  are  included  in 
this  section.  The  first  circuit  is  a band-pass  filter,  having  only 
passive  elements,  which  serves  to  illustrate  the  application  of  the 
algorithm  to  discrete  circuits  for  which  the  elements  are  not  corre- 
lated. This  circuit,  which  is  shown  in  Figure  5-6,  has  been  used  in 
two  example  solutions.  In  the  first  example,  normal  element  value  dis- 
tributions were  used  and  in  the  second  example,  nonnormal  distributions 
were  used.  The  second  circuit  is  a three-transistor,  low-pass  amplifier 
and  is  shown  in  Figure  5-7.  Circuit  number  two  was  used  in  the  third 
example,  which  illustrates  the  application  of  the  algorithm  to  inte- 
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© 


Program  error. 
atop  ■ 


Of  the  current  (A)  and  previous  (B) 
tolerance  sets  let  the  set  with  the 
larger  yield  now  be  called  set  A 
and  the  other  set  B. 


The  convergence 
criterion  has  been 
satisfied. 


* IT  = Iteration  Count 


Figure  5-5 


Detailed  flow  diagram  of  segment  5-5  of  Figure  5-1 
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6 7 

0.25yf  0.25yf 
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V. 


Figure  5-6 

Band-pass  filter  circuit  used  to  illustrate  the  case  of 
discrete  element  circuits. 
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CM 


Three-transistor  low-pass  amplifier  used  to  illustrate 
the  case  of  integrated  circuits. 
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grated  circuits  for  which  the  elements  are  correlated  and  for  which 
normal  element  value  distributions  were  used. 

The  first  example  is  a solution  of  the  band-pass  filter  of  Figure 
5-6.  This  circuit  has  the  voltage  gain  versus  frequency  curve  shown  in 
Figure  5-8.  The  object  of  this  solution  was  to  assign  element  toler- 
ances so  that  95.5  ±0.5%  of  the  manufactured  circuits  have  responses 
that  are  within  ±1.0  DB  of  the  nominal  response  curve.  Normal  element 
value  distributions  were  assumed.  The  input  data  for  the  example  are 
listed  in  Table  5-1.  Ten  frequency  points  were  considered  to  be  suffi- 
cient for  this  circuit.  The  values  of  the  upper  and  lower  responses 
correspond  exactly  to  the  ±1.0  DB  limits.  The  initial  values  of  the 
desired  response  variances  were  estimated  from  the  tolerances  of  the 
upper  and  lower  limits.  An  initial  desired  circuit  cost  of  $2.50  was 
estimated  as  a reasonable  minimum  cost. 

Table  5-2  lists  the  results  of  the  solution  of  example  one.  The 
results  of  each  iteration  of  the  algorithm  are  listed  so  that  we  may 
follow  the  actual  flow  of  the  algorithm.  As  can  be  seen  in  Table  5-2, 
the  algorithm  converged  to  the  desired  yield  in  5 iterations,  which 
required  52.1  seconds  of  computation  time  on  an  IBM  360/65  computer. 

The  final  two  steps  of  the  algorithm,  the  last  half  of  iteration  4 plus 
iteration  5,  used  slightly  over  half  of  the  computation  time,  which 
attests  to  the  usefulness  of  the  variable  sample  size  concept  in  Monte 
Carlo  analysis.  It  is  estimated  that  if  a sample  size  of  300  was  used 
throughout  the  algorithm,  the  computation  time  would  have  been  at  least 
85  seconds.  The  final  circuit  cost  is  $3.12. 

Example  two  is  another  solution  of  the  circuit  of  Figure  5-6.  In 
this  case  the  nonnormal  distribution  of  Figure  5-9  was  used,  which  is 
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Plot  of  voltage  gain  magnitude  versus  frequency  for  the  circuit 
of  Figure  5-6. 
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Table  5-1 

Input  data  for  continuous  tolerance  design  example  one. 


(a) 


Response 

Number 

Frequency 

(Hz) 

Desired 

Response 

Variance 

Response 

Weight 

Nominal 

Response 

Value 

Upper 

Response 

Limit 

Lower 

Response 

Limit 

1 

1003.0 

0.001 

3.0 

0.002278 

0.002556 

0.002030 

2 

2071.0 

0.001 

3.0 

0.03505 

0.03933 

0.03124 

3 

3134.0 

0.001 

3.0 

0.3286 

0.3687 

0.2929 

4 

3598.0 

0.001 

3.0 

0.4838 

0.5428 

0.4312 

5 

4530.0 

0.001 

3.0 

0.5000 

0.5610 

0.4456 

6 

5446.0 

0.001 

3.0 

0,4938 

0.5541 

0.4401 

7 

6253.0 

0.001 

3.0 

0.3814 

0.4279 

0.3399 

8 

6856.0 

0.001 

3.0 

0.2388 

0.2679 

0.2128 

9 

9465.0 

0.001 

3.0 

0.04091 

0.04590 

0.03646 

10 

19080.0 

0.001 

3.0 

0.002757 

0.003093 

0.002457 

(b) 


Element 

Nominal 

Value 

Upper 

Tolerance 

Limit 

Lower 

Tolerance 

Limit 

Cost 

Factor 

L3 

5.0  mh 

50% 

2% 

5.0 

L4 

5 . 0 mh 

50% 

2% 

5.0 

L5 

1.25  mh 

50% 

2% 

5.0 

C6 

0.25  -yf 

50% 

2% 

2.0 

C7 

0.25  yf 

50% 

2% 

2.0 

C8 

1.0  yf 

50% 

2% 

2.0 

(c) 


Cost  Weight 

0.1 

Desired  Circuit  Cost 

$2.50 

Desired  Yield 

95.5  ± 0.5% 

Output  data  for  continuous  tolerance  design  example  one. 
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Normalized  element  value 


Figure  5-9 


Bimodal  element  value  distribution  used  in  example  two. 
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a bimodal,  rectangular  type  of  distribution.  This  distribution  simu- 
lates the  distribution  that  occurs  when  smaller  tolerance  parts  are 
hand-picked  from  a batch  of  larger  tolerance  parts.  The  generation  of 
practically  any  type  of  distribution  is  a simple  matter  if  use  is  made 
of  the  uniform  probability  transformation  [32] . The  cumulative  proba- 
bility function  for  any  continuous  random  variable  is  uniformly  dis- 
tributed over  the  interval  0.0  to  1.0.  Thus,  to  obtain  a random  number 
from  a desired  distribution,  it  is  only  necessary  to  generate  a random 
number  from  a uniform  distribution  and,  using  this  number,  to  solve  the 
cumulative  probability  function  of  the  desired  distribution  for  the 
desired  random  number. 

For  the  second  example  the  goal  is  to  produce  a circuit  that  has 
responses  within  ±1.0  DB  of  the  nominal  response  with  a yield  of  100%. 
The  allowed  range  of  the  maximum  response  spread  is  0.9  to  1.0.  The 
input  data  for  this  example  are  listed  in  Table  5-3.  The  nonnormal 
distribution  necessitated  a change  in  the  values  of  the  desired  response 
variances  and  an  increase  in  the  desired  circuit  cost.  Table  5-A  lists 
the  results  for  this  example,  in  which  the  flow  of  the  algorithm  may  be 
traced.  The  final  circuit  cost  is  $7.84,  which  is  smaller  than  antici- 
pated. 

The  third  example  of  continuous  tolerance  design  is  a solution  of 

the  circuit  of  Figure  5-7,  which  has  the  voltage  gain  versus  frequency 

curve  shown  in  Figure  5-10.  For  this  example  the  specified  response 

3 7 

tolerance  between  1.0  x 10  and  2.0  x 10  Hz  is  ±0.5  DB  and  between 
7 9 

2.0  X 10  and  1.0  x 10  Hz  the  tolerance  increases  logarithmically  to 
±1.0  DB.  Since  this  example  serves  to  illustrate  an  integrated  circuit 
application  of  tolerance  design,  all  of  the  element  value  distributions 
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Table  5-3 

Input  data  for  continuous  tolerance  design  example  two. 


(a) 


Response 

Number 

Frequency 

(Hz) 

Desired 

Response 

Variance 

Response 

Weight 

Nominal 

Response 

Value 

Upper 

Response 

Limit 

Lower 

Response 

Limit 

1 

1003.0 

l.OxlO]^ 

3.0 

0.002278 

0.002556 

0.002030 

2 

2071.0 

1.0xl0_; 

3.0 

0.03505 

0.03933 

0.03124 

3 

3134.0 

1.0xl0_; 

3.0 

0.3286 

0.3687 

0.2929 

4 

3598.0 

5.0xio_; 

3.0 

0.4838 

0.5428 

0.4312 

5 

4530.0 

5.0xio_: 

3.0 

0.5000 

0.5610 

0.4456 

6 

5446.0 

5.0xio_; 

3.0 

0.4938 

0.5541 

0.4401 

7 

6253.0 

5.0xio_: 

3.0 

0.3814 

0.4279 

0.3399 

8 

6856.0 

i.Oxio_; 

3.0 

0.2388 

0.2679 

0.2128 

9 

9465.0 

i.Oxio_; 

3.0 

0.04091 

0.04590 

0.03646 

10 

19080.0 

1.0x10  ^ 

3.0 

0.002757 

0.003093 

0.002457 

(b) 


Element 

Nominal 

Value 

Upper 

Tolerance 

Limit 

Lower 

Tolerance 

Limit 

Cost 

Factor 

L3 

5.0  mh 

50% 

2% 

5.0 

L4 

5.0  mh 

50% 

2% 

5.0 

L5 

1.25  mh 

50% 

2% 

5.0 

C6 

0.25  yf 

50% 

2% 

2.0 

C7 

0.25  yf 

50% 

2% 

2.0 

C8 

1.0  yf 

50% 

2% 

2.0 

(c) 


Cost  Weight 

0.05 

Desired  Circuit  Cost 

$8.00 

Desired  Yield 

100.0% 

Desired  Spread  Range 

1.000  to  0.900 

Output  data  for  continuous  tolerance  design  example  two. 
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Plot  of  voltage  gain  magnitude  versus  frequency  for 
the  circuit  of  Figure  5-7. 
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were  normal.  Also,  all  of  the  resistors  and  transistors  were  assumed 
to  be  correlated.  The  input  data  for  this  example  are  listed  in 
Table  5-5.  Rather  than  choosing  correlation  parameters  at  random,  an 
effort  was  made  to  use  realistic  values.  Since  integrated  resistors 
with  the  values  indicated  in  Figure  5-7  would  be  base  diffusion  types, 
it  was  assumed  that  all  of  the  resistors  were  correlated  with  a slope 
of  1.0  and  a correlation  coefficient  of  0.9.  Resistor  R4  was  chosen  to 
be  the  independent  element  in  the  set  of  correlated  resistors.  Although 
the  transistors  in  reality  would  be  correlated  with  the  resistors  on 
the  same  chip,  it  was  assumed  that  the  correlation  between  transistors 
was  much  greater  than  the  correlation  between  transistors  and  resistors, 
since  an  extra  operation  is  performed  when  fabricating  transistors. 

Thus,  transistor  number  8 was  picked  as  the  independent  element  of  the 
correlated  set  with  transistors  11  and  16  related  to  it  by  a slope  of 
1.0  and  a correlation  coefficient  of  0.8.  The  beta  of  the  transistors 
was  the  only  transistor  parameter  that  was  allowed  to  vary.  An  Ebers- 
Moll  model  was  used  to  simulate  the  transistors  in  the  circuit  analysis 
subroutine. 

The  goal  of  this  example  was  to  produce  a tolerance  design  such 
that  98.0  ±1.0%  of  all  manufactured  circuits  have  responses  that  are 
within  the  specified  limits.  The  desired  circuit  cost  was  initially 
set  at  $1.50. 

The  results  of  the  tolerance  design  are  listed  in  Table  5-6. 

Because  of  the  large  circuit  size,  the  maximum  sample  size  was  not 
allowed  to  exceed  100  in  order  to  reduce  the  amount  of  computation  time. 
Even  with  the  reduced  sample  size,  the  results  are  fairly  accurate  and 
the  example  does  illustrate  the  performance  of  the  algorithm.  The 
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Table  5-5 

Input  data  for  continuous  tolerance  design  example  three. 


(a) 


Desired 

Nominal 

Upper 

Lower 

Response 

Frequency 

Response 

Response 

Response 

Response 

Response 

Number 

(Hertz) 

Variance 

Weight 

Value 

Limit 

Limit 

1 

1.0x10^ 

3. 8x10“ J 

10.0 

72.46 

76.74 

68.39 

2 

3 

2.0x10° 
4 . 0x10 , 

3.8x10  2 
3.8x10  7 

10.0 

10.0 

72.57 

72.92 

76.91 

77.27 

68.55 

68.87 

4 

5 

6.0x10^ 

8.0x10^ 

3.8x10  7 
3.8x1027 

10.0 

10.0 

73.47 

74.21 

77.80 

78.61 

69.34 

70.06 

6 

1.0x10^ 

3.8x10  , 

—a 

10.0 

75.08 

79.52 

70.88 

7 

1.2x10^ 

3.8xlO_7 

10.0 

76.01 

80.54 

71.78 

8 

9 

1.4x10^ 
1 . 6x10^ 

3.8x10  7 
3.8x10^ 

10.0 

10.0 

76.88 

77.53 

81.47 

82.13 

72.61 

73.20 

10 

1.8x10^ 

3.8x10  , 

10.0 

77.72 

82.32 

73.37 

11 

12 

2.0xl0' 

7.1568x10^ 

3.8x10 
5.2x10  , 

10.0 

2.0 

77.21 

8.172 

81.75 

8.731 

72.86 

7.655 

13 

14 

2.263xl0“ 

3.811x10^ 

5.358xl0“ 

6.905xl0„ 

6.5x10  7 
8.1xl0_7 

1.0 

1.0 

0.3521 

0.08093 

0.3791 

0.08784 

0.3270 

0.07452 

15 

16 

1.0x10  :: 
1.2x10  :: 

1.0 

1.0 

0.03183 

0.01838 

0.03486 

0.02029 

0.02909 

0.01666 

17 

8.453x10 

i.4xio_: 

1.0 

0.01361 

0.01515 

0.01223 

18 

1.0x10^ 

1.7x10“^ 

1.0 

0.01300 

0.01268 

0.01007 
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Table  5-5  (continued) 


(b) 


Element 

Nominal 

Value 

Upper 

Tolerance 

Limit 

Lower 

Tolerance 

Limit 

Cost 

Factor 

Element 

Dependent 

On 

Correlation 

Coefficient 

Slope  of 
Linear 
Relation- 
ship 

C3 

1.0  pf 

50% 

2% 

1.0 

- 

- 

- 

R4 

6.0  m 

50% 

2% 

1.0 

- 

- 

- 

R5 

2.5  m 

50% 

2% 

1.0 

R4 

0.9 

1.0 

R6 

1.9  Kfl 

50% 

2% 

1.0 

R4 

0.9 

1.0 

R7 

290.0 

50% 

2% 

1.0 

R4 

0.9 

1.0 

88 

120.0 

60% 

10% 

1.0 

- 

- 

- 

311 

120.0 

60% 

10% 

1.0 

38 

0.8 

1.0 

R14 

290.0 

50% 

2% 

1.0 

R4 

0.9 

1.0 

R15 

10.6  Kfl 

50% 

2% 

1.0 

R4 

0.9 

1.0 

816 

120.0  0. 

60% 

10% 

1.0 

38 

0.8 

1.0 

(c) 


Cost  Weight 

0.1 

Desired  Circuit  Cost 

$1.50 

Desired  Yield 

98.0  ± 1.0% 

Output  data  for  continuous  tolerance  design  example  three. 
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Decreased  desired  circuit  cost.  Increased  desired  response  variances. 
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final  circuit  cost  is  $0,80  and  the  resulting  yield  is  98.0%.  The 
computation  time  for  this  example  was  considerably  greater  than  that 
of  the  previous  examples  because  of  the  circuit  size  and  the  initial 
desired  circuit  cost  being  overestimated. 

As  mentioned  previously,  the  optimization  methods  used  in  this 
algorithm  will  not  always  converge  to  the  global  minimum.  This  means 
that  the  tolerance  set  resulting  from  an  application  of  this  tolerance 
design  algorithm  may  be  only  a local  minimum.  The  accepted  method  for 
finding  a different  minimum  is  to  choose  a different  starting  point. 

In  this  case,  it  would  mean  choosing  different  initial  values  for  the 


element  tolerances. 


CHAPTER  6 


A COMPUTER-AIDED  TOLERANCE  DESIGN  ALGORITHM 
FOR  DISCRETE  TOLERANCES 


The  tolerance  design  algorithm  described  in  Chapter  5 produces  a 
set  of  element  tolerances,  each  of  which  can  assume  any  value  within 
their  respective  upper  and  lower  limits.  Now,  however,  we  desire  to 
design  tolerances  in  the  case  where  the  tolerances  are  discrete 
variables . 

The  method  proposed  for  accomplishing  discrete  tolerance  design  is 
shown  in  the  simplified  flow  diagram  of  Figure  6-1.  The  first  step  of 
this  algorithm  is  to  perform  a continuous  tolerance  design,  which 
produces  a set  of  nondiscrete  tolerances  that  will  be  called  the  ap- 
proximate tolerance  set.  It  is  assumed  that  a locally  optimum  discrete 
tolerance  set  is  in  the  vicinity  of  the  approximate  set,  which  itself 
is  a locally  optimum  continuous  tolerance  set.  Therefore,  the  approxi- 
mate tolerance  set  is  used  as  the  starting  point  in  the  discrete  toler- 
ance search. 

Having  determined  the  approximate  tolerance  set,  the  next  step  is 
to  form  a table  of  discrete  tolerance  sets,  all  of  which  are  in  the 
vicinity  of  the  approximate  set.  Only  those  discrete  tolerance  values 
that  are  closest  to  the  approximate  values  (one  above  and  one  below) 
are  used,  which  means  that  no  more  than  two  discrete  tolerance  values 
per  circuit  element  will  be  considered.  The  table  of  closest  discrete 
tolerance  sets  is  formed  by  generating  all  possible  combinations  of  the 
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Figure  6-1 


Simplified  flow  diagram  of  the  discrete  tolerance 
design  algorithm. 
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allowed  discrete  tolerances.  Thus,  the  number  of  closest  discrete 
tolerance  sets  will  be  no  greater  than  where  n is  the  number  of 
circuit  elements.  The  closest  discrete  tolerance  sets  are  then  placed 
in  order,  relative  to  their  respective  circuit  costs,  and  finally  the 
table  is  searched,  set  by  set,  until  the  locally  optimum  discrete  tol- 
erance set  is  found.  The  locally  optimum  discrete  tolerance  set  is 
the  least  costly  set  in  the  table  that  has  a yield  equal  to  or  greater 
than  the  desired  yield. 

Karafin's  method  (described  in  Chapter  3)  uses  a larger  number  of 
possible  discrete  sets  than  used  in  this  method.  In  his  method  any 
discrete  values  within  the  table  of  pairwise  constraints  are  permitted, 
so  it  is  possible  to  have  more  than  two  possible  discrete  tolerance 
values  per  element.  In  the  algorithm  presented  here,  the  set  of  closest 
discrete  tolerance  sets  is  a subset  of  those  used  in  the  Karafin  method. 
Also,  this  method  starts  its  search  from  a point  close  to  a locally 
optimum  solution,  whereas,  in  the  Karafin  method  the  search  is  started 
with  the  set  having  the  lowest  possible  cost. 

6. 1 Detailed  Description  of  Algorithm 

The  fully  detailed  flow  diagram  of  the  discrete  tolerance  design 
algorithm  is  contained  in  Figures  6-2  through  6-4.  Figure  6-2  shows 
the  initial  portion  of  the  algorithm.  The  very  first  step  is  to  read 
in  input  data.  Since  a continuous  tolerance  design  is  performed  to 
compute  an  approximate  tolerance  set,  all  of  the  data  listed  in  Chap- 
ter 5 must  be  entered.  In  addition,  we  must  enter  lists  of  possible 
discrete  tolerance  values  for  each  element  and  also  enter  the  cost 
associated  with  each  tolerance  value.  In  the  continuous  case  the 
element  cost  was  computed  by  an  approximate  formula,  but  in  the  discrete 


case  the  exact  element  cost  is  used. 


* ISM  = Sample  size 


Figure  6-2 

Detailed  flow  diagram  of  initial  part  of  discrete  tolerance 
design  algorithm. 
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The  approximate  tolerance  set  is  referred  to  as 
t'*'  = (t  , t , . . . , t . ) , where  n is  the  number  of  circuit  elements 


-A 


-Ai*  A^ 


n 


and  t^  is  the  approximate  tolerance  of  the  (i)th  element  as  computed 
i 

using  the  continuous  tolerance  design  algorithm.  Before  generating  a 
table  of  discrete  tolerance  sets  the  algorithm  selects  two  closest 
discrete  tolerance  sets.  One  of  the  sets  is  , which  is  the  set  of 
discrete  tolerances  having  values  that  are  equal  to  or  next  larger  than 


the  values  in  t..  The  other  is  t^ , which  is  the  set  of  discrete  tol- 
— A — L 

erance  values  that  are  equal  to  or  next  smaller  than  the  values  in  ^ . 


For  example,  if  the  (i)th  element  has  possible  discrete  tolerance 

values  of  2,  3,  5,  or  10%  and  t^  = 4.75%,  then  the  value  of  t^  is  5% 

i i 

and  t is  3%.  If  case  t is  within  0.1%  of  one  of  the  discrete 
L . A . 

1 1 

tolerance  values  then  we  set  t^  ~ *"l  ’ Setting  t^  = t^  reduces  the 

^i  ^i  i i 

number  of  generated  discrete  tolerance  sets  by  one-half. 

The  starting  point  in  the  discrete  tolerance  design  algorithm  is 

the  set  of  discrete  tolerance  values  that  is  closest  to  and  is 

called  the  reference  tolerance  set,  A variable  sample  size  Monte 

Carlo  analysis  is  performed  using  the  discrete  tolerance  values  of 

and  the  circuit  yield  is  then  computed.  For  discrete  tolerance  design 

a yield  is  considered  acceptable  if  it  is  equal  to  or  larger  than  the 

desired  yield  at  the  largest  sample  size.  The  result  of  this  Monte  Carlo 

analysis  determines  the  subsequent  flow  of  the  algorithm. 

If  the  Monte  Carlo  analysis,  using  the  reference  tolerance  set 

produces  a yield  that  is  not  satisfactory,  then  the  program  flow  goes 

to  the  portion  of  the  flow  diagram  detailed  in  Figure  6-3.  The  first 

step  in  this  portion  is  to  generate  sets  of  discrete  tolerance  values 

that  are  of  the  same  cost  as  or  more  costly  than  the  reference  set, 
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Figure  6 -3 

Detailed  flow  diagram  of  second  part  of  discrete  tolerance 
design  algorithm. 
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The  discrete  sets  are  generated  by  taking  all  possible  combinations  of 

the  discrete  tolerances  of  sets  t„  and  t,  . As  a set,  t , is  generated 

its  cost  is  computed  and  compared  with  the  cost  of  If  the  cost  of 

t , called  c , is  less  than  c^,,  the  cost  of  t„ , then  set  t is 
-new’  new  R -new 

discarded  and  another  generated.  If  is  equal  to  or  greater  than 

c„,  then  set  t is  placed  in  the  table  of  discrete  tolerance  sets  in 
order  of  Increasing  cost.  To  conserve  computer  storage  space,  the  table 
consists  of  no  more  than  25  sets  at  any  one  time.  In  the  event  that 
none  of  the  25  discrete  tolerance  sets  has  a satisfactory  yield,  then 
a new  table  of  tolerance  sets  is  generated  which  continues  where  the 
previous  table  stopped.  The  discrete  tolerance  sets  generated  by  the 
algorithm  are  denoted  by  _t2,  . . .,  where  IM  is  equal  to  or 

less  than  25. 

The  final  part  of  Figure  6-3  is  a search  of  the  table,  using 
variable  sample  size  Monte  Carlo  analysis,  to  find  the  locally  optimum 
discrete  tolerance  set.  In  this  case  the  locally  optimum  set  is  the 
first  one  to  have  a satisfactory  yield.  The  discrete  sets  are  tested 
one  by  one,  proceeding  in  order  of  increasing  cost. 

Going  back,  briefly,  to  Figure  6-2,  we  see  that  if  the  reference 
set,  t , produces  a satisfactory  yield  then  the  flow  of  the  algorithm 
proceeds  to  Figure  6-4.  The  flow  diagram  in  Figure  6-4  is  essentially 
the  same  as  that  of  Figure  6-3.  However,  in  Figure  6-4  the  table  of 
generated  discrete  tolerance  sets  consists  of  those  that  are  less  costly 
than  t . The  variable  sample  size  search  procedure  is  more  complicated 
in  this  section  because  we  are  now  looking  for  the  first  discrete  tol- 
erance set  to  have  an  unsatisfactory  yield.  Then  the  algorithm  must 
back-track  to  find  the  last  set  that  has  a satisfactory  yield. 
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Detailed  flow  diagram  of  final  part  of  discrete  tolerance 
design  algorithm. 
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6. 2 Examples 

A program  of  the  discrete  tolerance  design  algorithm  has  been 
written  and  tested  successfully.  Two  of  the  solutions  are  included 
here  as  examples  of  the  capability  of  this  algorithm. 

The  first  example  of  discrete  tolerance  design  is  performed  on 
the  circuit  of  example  one  of  Chapter  5.  This  circuit  is  the  band- 
pass filter  shown  in  Figure  5-6.  The  specified  response  tolerance  was 
±1.0  DB  over  the  frequency  range  and  the  desired  yield  was  95.5%.  The 
element  value  distributions  were  assumed  to  be  normal.  The  continuous 
tolerance  design  solution  of  example  one  of  Chapter  5 was  used  as  the 
approximate  tolerance  set  in  the  discrete  tolerance  design.  The 
remainder  of  the  input  data  are  listed  in  Table  6-1.  Three  possible 
values  of  discrete  tolerances  were  considered  for  each  element. 

The  results  of  the  discrete  tolerance  design  procedure  are  listed 
in  Table  6-2  and  are  in  the  order  in  which  they  occurred.  In  this  case 
the  reference  tolerance  .set  did  not  pass  the  Monte  Carlo  test,  so  the 
table  of  discrete  tolerance  sets  consisted  of  those  sets  having  a cost 

equal  to  or  greater  than  the  cost  of  t . The  algorithm  required  27 

■“K 

iterations  before  it  converged.  The  circuit  cost  using  the  discrete 
tolerances  of  this  solution  is  $3.77,  whereas  the  circuit  cost  using 
the  approximate  tolerance  set  is  $3.12.  This  type  of  cost  difference 
is  to  be  expected  because  it  is  possible  to  find  a local  minimum  in 
the  continuous  variable  case  but  with  discrete  variables  the  local 
minimum  can  usually  only  be  approximated. 

The  second  discrete  tolerance  design  example  uses  the  same  circuit 
that  was  used  for  example  two  in  Chapter  5.  This  circuit  is  the  same 
band-pass  filter  used  in  the  first  discrete  tolerance  design  example, 


Table  6-1 


Input  data  for  discrete  tolerance  design  example  one. 


Element 

Approximate 

Percent 

Tolerance 

Element  costs  for  possible 
discrete  tolerance  values. 

3% 

5% 

10% 

L3 

7.77 

$1.67 

$1.00 

$0.50 

L4 

7.77 

$1.67 

$1.00 

$0.50 

L5 

6.48 

$1.67 

$1.00 

$0.50 

C6 

6.72 

$0.67 

$0.40 

$0.20 

C7 

6.72 

$0.67 

$0.40 

$0.20 

C8 

4.32 

$0.67 

$0.40 

$0.20 

100 


Table  6-2 


Results  of  discrete  tolerance  design  example  one. 


Set 

Circuit 

Cost 

Percent 
Yield  . 

Element 

Percent 

Tolerance 

Sample 

Size 

Elapsed 

Time 

(seconds) 

Notes 

3 

4 

5 

6 

7 

8 

0 

$3.20 

95.0 

10 

10 

5 

5 

5 

5 

20 

4.2 

a 

1 

3.20 

85.0 

10 

5 

10 

5 

5 

5 

20 

2 

3.20 

85.0 

5 

10 

10 

5 

5 

5 

20 

3 

3.27 

85.0 

10 

5 

10 

5 

10 

3 

20 

4 

3.27 

90.0 

5 

10 

10 

5 

10 

3 

20 

5 

3.27 

90.0 

10 

10 

5 

5 

10 

3 

20 

6 

3.27 

90.0 

10 

5 

10 

10 

5 

3 

20 

7 

3.27 

85.0 

5 

10 

10 

10 

5 

3 

20 

8 

3.27 

90.0 

10 

10 

5 

10 

5 

3 

20 

9 

3.30 

85.0 

5 

5 

10 

10 

10 

5 

20 

10 

3.30 

95.0 

10 

5 

5 

10 

10 

5 

20 

11 

3.30 

95.0 

5 

10 

5 

10 

10 

5 

20 

12 

3.47 

90.0 

10 

5 

10 

5 

5 

3 

20 

13 

3.47 

85.0 

5 

10 

10 

5 

5 

3 

20 

14 

3.47 

95.0 

10 

10 

5 

5 

5 

3 

20 

15 

3.50 

70.0 

5 

5 

10 

5 

10 

5 

20 

16 

3.50 

100.0 

10 

5 

5 

5 

10 

5 

20 

36.3 

b 

It 

II 

93.0 

11 

It 

It 

II 

tt 

It 

100 

17 

3.50 

91.0 

5 

10 

5 

5 

10 

5 

100 

18 

3.50 

88.0 

5 

5 

10 

10 

5 

5 

100 

19 

3.50 

94.0 

10 

5 

5 

10 

5 

5 

100 

20 

3.50 

94.0 

5 

10 

5 

10 

5 

5 

100 

21 

3.57 

83.0 

5 

5 

10 

10 

10 

3 

100 

22 

3.57 

96.0 

10 

5 

5 

10 

10 

3 

100 

99.4 

b 

II 

It 

93.3 

It 

It 

It 

tt 

tt 

II 

300 

23 

3.57 

93.3 

5 

10 

5 

10 

10 

3 

300 

151.0 

24 

3.70 

85.0 

5 

5 

10 

5 

5 

3 

20 

c 

25 

3.70 

95.0 

5 

10 

5 

5 

5 

5 

20 

26 

3.70 

95.0 

10 

5 

5 

5 

5 

5 

20 

27 

3.77 

100.0 

5 

10 

5 

5 

10 

3 

20 

161.1 

b 

II 

It 

96.0 

II 

It 

It 

II 

It 

II 

100 

168.5 

b 

II 

It 

96.0 

II 

tt 

tt 

It 

It 

tl 

300 

186.9 

d 

The  reference  set  did  not  have  a satisfactory  yield. 

'^Increased  sample  size. 

Q 

The  program  stopped  at  this  point  due  to  the  maximum  elapsed  time 
being  exceeded.  The  program  was  then  restarted,  which  is  why  the 
algorithm  reverted  to  a sample  size  of  20. 

*^The  discrete  algorithm  has  converged. 
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except  that  a yield  of  100%  was  desired  and  a bimodal  element  value 

distribution  was  used.  Again,  the  results  of  the  continuous  tolerance 

design  were  used  as  the  approximate  tolerance  set.  The  input  data  for 

this  example  are  listed  in  Table  6-3.  It  was  only  necessary  to  enter 

two  possible  discrete  tolerance  values  for  each  element. 

The  results  of  this  second  discrete  tolerance  design  example  are 

tabulated  in  Table  6-4.  In  this  case  the  circuit  cost  using  the 

tolerance  values  of  this  solution  is  $8.01.  The  circuit  cost  using  the 

approximate  tolerance  set  is  $7.84.  Since  element  8 had  an  approximate 

tolerance  value  of  2.00%,  the  values  of  t and  t were  also  2.00%. 

^8  ^8 

This  reduced  the  number  of  possible  discrete  tolerance  sets  and  speeded 
up  the  solution  considerably. 


Table  6-3 


Input  data  for  discrete  tolerance  design  example  two. 


Element 

Approximate 

Percent 

Tolerance 

Element  cost  for 
possible  discrete 
tolerance  values 

2% 

3% 

L3 

2.87 

$2.50 

$1.67 

L4 

2.87 

$2.50 

$1.67 

L5 

2.58 

$2.50 

$1.67 

C6 

2.81 

$1.00 

$0.67 

C7 

2.81 

$1.00 

$0.67 

C8 

2.00 

$1.00 

$0.67 
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Table  6-4 

Results  of  discrete  tolerance  design  example  two. 


Set 

Circuit 

Cost 

Percent 
Yield  . 

Element 

Percent 

Tolerance 

Sample 

Size 

Elapsed 

Time 

(seconds) 

Notes 

3 

4 

5 

6 

7 

8 

0 

$7.35 

100.0 

3 

3 

3 

3 

3 

2 

20 

a 

tl 

tl 

100.0 

It 

II 

tl 

It 

II 

It 

100 

a 

II 

It 

98.7 

II 

It 

It 

II 

II 

It 

300 

29.1 

b 

1 

7.68 

100.0 

3 

3 

3 

3 

2 

2 

20 

31.2 

a 

II 

II 

99.0 

It 

It 

II 

II 

II 

It 

100 

2 

7.68 

99.0 

3 

3 

3 

2 

3 

2 

100 

3 

8.01 

100.0 

3 

3 

3 

2 

2 

2 

100 

56.1 

a 

II 

II 

100.0 

tl 

tl 

II 

It 

II 

tl 

300 

73.9 

c 

^Increased  sample  size. 

^The  reference  set  does  not  have  a satisfactory  yield. 
The  discrete  algorithm  has  converged. 


CHAPTER  7 


SUMMARY  AND  RECOMMENDATIONS  FOR  FURTHER  RESEARCH 


This  dissertation  has  presented  a study  of  the  problems  of 
computer-aided  tolerance  design  of  electrical  circuits  and  has  also 
presented  two  new  algorithms  for  tolerance  design.  The  most  useful 
existing  methods  of  variability  analysis  were  reviewed  and  most  of  the 
existing  methods  of  tolerance  design  were  explained.  The  problems  of 
interdependence  between  circuit  elements,  which  are  encountered  in 
integrated  circuits,  were  discussed.  A small  amount  of  experimental 
data  were  obtained , which  showed  that  the  linear  relationship  between 
correlated  elements  can  have  various  slopes.  It  was  found  that  re- 
sistors on  an  integrated  circuit,  which  were  fabricated  using  different 
techniques,  can  have  nonunity  slopes.  It  was  also  found  that  a set  of 
resistors  on  an  integrated  circuit,  which  were  fabricated  using  the 
same  technique,  had  a unity  slope. 

A method  was  developed  for  generating  an  arbitrary  number  of  sets 
of  random,  correlated,  normally  distributed  element  values  for  which 
the  slopes,  correlation  coefficients,  and  standard  deviations  are 
variables.  Also,  a constraint  on  the  standard  deviations  of  correlated 
elements  was  hypothesized.  This  hypothesis  was  not  proved,  but  all  of 
the  available  experimental  data  did  conform  to  the  constraint. 

The  main  part  of  this  dissertation  was  the  presentation  of  two  new 
algorithms  for  the  computer-aided  design  of  circuit  element  tolerances. 
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The  first  algorithm  was  developed  for  the  case  where  the  element  toler- 
ances are  continuous  variables.  This  algorithm  takes  into  account  the 
interdependence  of  circuit  elements  and  also  utilizes  Monte  Carlo  anal- 
ysis in  its  main  iteration  loop.  The  use  of  a variable  sample  size  in 
the  Monte  Carlo  analysis  reduces  the  amount  of  computation  time  consid- 
erably. The  Monte  Carlo  analysis  makes  use  of  the  previously  mentioned 
method  of  generating  sets  of  correlated  element  values.  This  algorithm 
for  continuous  tolerance  design  is  expected  to  be  of  use  in  the  design 
of  integrated  circuits. 

The  second  algorithm  was  developed  for  the  case  where  the  element 
tolerances  are  discrete  variables.  This  algorithm  makes  use  of  a con- 
tinuous tolerance  design  solution  as  a starting  point.  Only  those 
discrete  tolerance  sets  which  are  close  to  the  starting  point  are  used 
in  a search  for  the  locally  optimum  discrete  tolerance  set.  The 
variable  sample  size  Monte  Carlo  analysis  is  used  in  this  search. 

Two  practical  electrical  circuits  were  used  in  examples  of  computer- 
aided  tolerance  design  using  both  the  continuous  and  discrete  algorithms. 

There  is  a considerable  amount  of  research  remaining  to  be  done  in 
the  area  of  computer-aided  tolerance  design.  Most  of  the  research  to 
date  has  been  centered  on  finding  a fast,  exact  deterministic  method 
for  assigning  element  tolerances,  given  the  design  specifications. 
However,  in  all  of  these  attempts,  only  approximate  solutions  have  been 
found  and  in  all  cases  the  results  have  had  to  be  verified  by  Monte 
Carlo  analysis  (a  statistical  or  stochastic  method).  The  Monte  Carlo 
method  gives  the  most  dependable  results,  because  if  the  model  used  in 
the  analysis  is  exact  then  the  individual  response  points  will  be  exact. 
However,  when  computing  the  resulting  tolerances,  mean  values,  and 
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standard  deviations  we  have  the  inherent  uncertainties  of  a statistical 
sample.  To  reduce  the  uncertainty,  or  probability  of  error,  the  sample 
size  must  be  increased,  which  can  become  very  costly.  In  view  of  this, 
a recommendation  for  research  is  to  continue  the  quest  for  a fast, 
exact  deterministic  method  for  tolerance  analysis  and  design. 

More  specific  recommendations  for  future  research  can  be  made  for 
determining  the  statistical  characteristics  of  integrated  circuit  ele- 
ments. Primarily,  experiments  should  be  designed  to  determine  (1)  the 
factors  that  affect  the  slope  of  the  linear  relationship  between  elements, 
(2)  the  factors  that  affect  the  coefficient  of  linear  correlation  between 
elements,  and  (3)  to  determine  if  the  relationships  are  always  linear. 
Another  recommendation  is  to  design  an  experiment  to  test  the  above- 
mentioned  hypothesis  on  the  constraints  between  standard  deviations  of 
correlated  circuit  elements. 

In  the  continuous  tolerance  design  algorithm  it  was  assumed  that 
correlation  coefficients  and  slopes  were  fixed  quantities  with  only  the 
standard  deviations  being  variables.  A final  research  recommendation 
is  to  determine  if  the  slopes  and  correlation  coefficients  can  also  be 
variables  in  a practical  sense. 


APPENDIX  A 


DERIVATION  OF  THE  PROPAGATION  OF  VARIANCE  EQUATION 

The  variance  of  a distribution  is  a measure  of  its  dispersion 
about  its  mean  value.  An  expression  for  the  variance  of  a general 
function,  A(£),  may  be  derived  through  the  use  of  the  Taylor  series. 

£ is  the  vector  of  n parameters, 

T 

£ ~ P2’  • • •>  Pj^^  • (A»l) 

Before  starting  with  the  derivation  several  definitions  and  relation- 
ships must  be  given  [33]. 

The  expected,  or  mean,  value  of  a function  of  a random  variable, 

X,  is  denoted  by  E[f(x)].  If  f(x)  equals  a constant  we  have 

E(c)  = c , (A. 2) 

if  f(x)  = cx,  then 

E(cx)  = cE(x) , (A. 3) 

and  the  expected  value  of  a linear  combination  of  random  variables  is 

n 

= I c.E(x.)  . (A. 4) 

i=l  ^ ^ 

The  variance  of  a random  variable  x is  defined  as 

Var(x)  = E[x-E(x)]^  (A. 5) 

and  is  called  the  second  central  moment  of  the  distribution  of  x.  The 
covariance  between  two  random  variables,  x and  y,  is 

Cov(x,y)  = e{[x-E(x)] [y-E(y)l } , (A. 6) 

and  the  correlation  coefficient  between  x and  y is 


n 


i=l 


CiXi 
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3 = Cov(x,y)  ^ Cov(x,y) 

[Var(x)Var(y)]'^  ^x*^y 


(A.7) 


where  a = Aar (x) . a is  called  the  standard  deviation  of  x. 

X X 

The  standard  formulas  for  estimating  the  mean,  variance,  and  co- 
variance  from  sets  of  data  are. 


1 

— ^ 
E(x)  = X = — , 


(A. 8) 


^ - 9 

I 

vat(.)  = aj  . izl_ 


(A.  9) 


and 


R 


Cov(x,y)  = 


I (x  -x)(y  -y) 
i=l 


(A. 10) 


where  R is  the  number  of  samples  in  the  data  sets. 

The  expansion  of  the  function  A(£)  in  a Taylor  series  about  the 
point  E(£)  is  given  by 


n 


A(£)  = A[E(£)]  + I 1^  [p.-E(p.)] 


dp.  ^i  *^i 

1=1 


+ I [p^E(p  )][p  -E(p  )]  , (A.ll) 

j=l  i=l  ^Pi^p.  1 i J J 


where  n is  the  number  of  elements  in  £,  all  partials  are  evaluated  at 
E(£),  and  higher  than  second  order  terms  are  ignored.  The  expected 
value  of  A(£)  can  be  found  by  applying  equations  (A. 2)  through  (A. 4). 
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E[A(£)]  = A[E(£)]  + I E[p.-E(p.)] 

i=l 


+ hl  ^ E [p.-E(p  )]2 
i=l  3p/ 


+ ! I 4^MPi-e(p,)1[Pj-e(Pj)1  . 


(A. 12) 


i=l  j=i+l  ^2 

The  variance  of  A(£)  can  be  found  by  performing  the  operations  indicated 

in  equation  (A. 5),  that  is,  subtracting  equation  (A. 12)  from  (A. 31), 

squaring,  and  then  finding  the  expected  value  of  the  result.  Termsof 

2 

9A  9 a 

higher  than  second  order,  e.g.,  ^3x9y^ ’ ignored.  First  we 

have 


9A 


A(£)  - E[A(£)]  = I ^ [P,-E(p,)j  - E[p,-E(p,)] 


> 9p.  ^i  ‘ i' 

1=1  1 


1 1 


+ second  order  terms.  (A. 13) 

Since  E[p^-E(p^)]  = E(p^)  - E(p^)  = 0,  the  above  expression  becomes 

A(£)  - E[A(£)]  . I [p.-E(p.)] 

i=l  ^i 

+ second  order  terms.  (A. 14) 

Now,  by  squaring  (A. 14)  and  applying  the  expected  value  operator  we 
obtain 

E A(£)-E[A(y_;j  " = E ^ [p.-E(p.)] 

i=l  ^i 


n n 


\i=l  j=l 


" ,3A  2 


n n 


i=l  ^1  1=1  j=i+l  ^i 


)]  . 


(A. 15) 


no 


With  the  application  of  equations  (A. 2)  through  (A. 7)  the  last 
equation  becomes 

VartA(£)]  = I (|^)^  Var(p.)  + 2 ^ I (|f-)  (|^)  Cov(p.,p  ) , (A.  16) 

i=l  ^i  i=l  j=i+l  ^i 

which  is  the  general  form  of  the  propagation  of  variance  equation. 

In  the  event  that  all  circuit  elements  are  independent,  and  Cov(p^,p^)  = 0 

for  all  i and  j such  that  i 7^  j , equation  (A.  16)  becomes 

n 2 

Var[A(p)l  - al  • I (1^)  . (A. 17) 

The  general  form  of  (A. 16)  in  matrix  notation  is 


2 T 

a,  = a [X]a 
A — p — p 


where 


(A. 18) 


T 

= (a 

-P  Pi 


% ^ 
n 


(A.  19) 


9 A 9 A 

[X]  is  an  nxn  matrix  with  its  i-jth  element  given  by  x = (p  . • 

J J «3P^  op^ 

The  covariance  term  in  (A. 16)  has  been  replaced  by  p..a  0 (see 

Pi  Pj 


equation  (A. 7)).  Note  that  p^^  = 1.0. 

In  some  cases  it  is  preferable  to  work  with  normalized  variances, 
sensitivities,  and  element  values.  The  normalized  values  are  defined 
as 


and 


S. 

1 


p^/Pi  , 

Zi 

A 8p.  ’ 


■ "p/’’!  ■ 


The  normalized  version  of  equation  (A. 16)  thus  is 


0-, 


- z ^ .z  . z 


n 


i=l 


i=l  j=i+l 


s.s.p. .a~  a~ 

1 J 13  P^  Pj 


(A. 20) 
(A. 21) 


(A. 22) 


(A. 23) 


APPENDIX  B 


GRADIENT-TYPE  OPTIMIZATION  METHODS 


General  nonlinear  functions,  such  as  the  objective  functions 
used  in  computer-aided  design,  can  be  minimized  by  use  of  any  of  a 
number  of  optimization  algorithms.  Two  of  the  major  classifications 
of  optimization  methods  are  the  direct  search  type  and  the  gradient 
type.  In  the  direct  search  methods  the  gradient  information  is  not 
used.  Hence,  the  main  applications  of  direct  search  methods  are  for 
cases  where  it  is  not  possible  or  not  convenient  to  compute  the  func- 
tion gradient  vector. 

Knowing  the  gradient  vector  of  a function  can  be  of  great  value 
when  attempting  to  minimize  or  maximize  a function.  For  example,  if 
someone  is  trying  to  climb  to  the  top  of  a hill,  it  is  helpful  to  know 
the  uphill  direction.  The  computation  of  gradients  of  the  objective 
functions  used  in  electrical  circuit  design  is  a simple  matter  if  use 
is  made  of  the  adjoint  circuit  technique  [13].  The  most  widely  used 
gradient-type  optimization  methods  are  the  steepest  descent  method, 
the  conjugate-gradient  method,  and  the  Fletcher-Powell  method.  These 
methods  have  been  explained  elsewhere  so  they  will  receive  only  a 
brief  mention  here  [34]. 

The  steepest  descent,  conjugate-gradient,  and  Fletcher-Powell 
methods  all  require  a one-dimensional  search  (or  minimization)  along 
a search  direction  once  during  each  iteration.  In  the  steepest  descent 
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method  the  search  direction  is  simply  the  negative  of  the  gradient 
vector,  whereas  in  the  conjugate-gradient  and  Fletcher-Powell  methods 
more  complicated  formulas  are  used  to  find  the  search  direction.  The 
one-dimensional  search  often  consumes  a considerable  amount  of  compu- 
tation time. 

More  recently,  optimization  methods  have  been  developed  which  do 
not  require  a one-dimensional  search.  Three  of  these  methods  are 
Davidon’s  Variance  Algorithm,  Fletcher's  Algorithm,  and  the  Jacobson- 
Oksraan  Algorithm  [30,35,31].  In  the  descriptions  of  these  methods  we 
will  assume  that  a function  f (x)  is  being  minimized  and  that  the  func- 
tion has  the  gradient  vector  denoted  by 


T , .T 

£ = £.(x) 


9f 

9x2’  ' 


IL 

9x 


■)  , 


n 


(B.l) 


where  n is  the  number  of  elements  in  x, 

Davidon's  Variance  Algorithm  is  similar  to  the  Fletcher-Powell 
method  in  that  a matrix  is  stored  and  updated  in  each  iteration.  The 
steps  of  the  algorithm  are  listed  below. 

(1)  Start  with  an  estimate  of  the  minimum  point,  and  a sym- 
metric, positive  definite  matrix  The  (i)th  iteration 

(i  = 0,  1,  . . .)  then  proceeds  as  follows. 

(2)  Compute  f^  = f(x^)  and  = ^(x^) . 

(3)  Set  x^  = x^  “ Compute  f^  = f(^^)  and  • 

(4)  Set  and  If  < £ then  the  algorithm 

stops  and  the  minimum  point  is  e is  a positive  real  number  used  as 

a convergence  criterion. 


-a 


(5)  Set  Y-  = -gtr./p..  If  < J.  < X.  = a, 

'1  -^1— 1 1+a  - 'i  1-a  1 

< Y.  < X.  = ',  if  < Y < set  X.  = B, 

3+1  - 1 1+a  1 3-1  - 3+1  1 


if 

and  if  none 
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Yi 

of  these  three  conditions  are  met  set  A.  - . a and  3 are  real 

^ ^i+1 

numbers  such  that  0 < a < 1 <3,  which  are  set  at  the  beginning  of  the 
algorithm  and  which  place  bounds  on  the  single  iteration  change  in  the 
matrix  [H] . 

(6)  Update  the  [H]  matrix. 


[Hi^l]  = [H.]  + (A,-l)rV/p, 

(7)  If  f . < f . set  = X.  , f = f and  . If  f . > f . 

set  = X.,  f._^^  = f.,  and  = £..  Go  to  step  (3). 

For  quadratic  functions  the  matrix  [H]  becomes  equal  to  the  inverse 
of  the  Hessian  matrix  upon  convergence.  Also,  for  quadratic  functions, 
Davidon's  method  can  be  proved  to  converge  within  n iterations.  It  is 
argued  that  the  property  of  quadratic  convergence  is  beneficial  because 
practically  all  functions  exhibit  quadratic  behavior  in  the  vicinity  of 
a minimum. 

In  Fletcher's  Algorithm  the  property  of  quadratic  convergence  was 
abandoned  in  order  to  find  a more  efficient  replacement  for  the  one- 
dimensional search.  Fletcher's  Algorithm  proceeds  as  follows. 

(1)  Start  with  an  estimate  of  the  minimum  point,  x^,  and  a symmetric, 
positive  definite  matrix  [H^].  The  (i)th  iteration  (i  = 0,  1,  2,  . . .) 
consists  of  the  following  steps. 

(2)  Compute  f^  = f(Xj^)  and  = g.(Xj^)  • 

(3)  Set  x^_^2  ^ -i  ~ ^ initially  made  equal  to  one,  but 

if  f is  not  reduced  enough  a value  of  A is  determined  by  cubic  inter- 
polation. The  value  of  A is  not  allowed  to  be  less  than  0.1. 

(4)  Compute  = fCx^+i)  and 

(5)  Set  6.  = x.^^  - X.  and 
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(6)  If  6^7^^  < e then  the  algorithm  stops,  e is  a positive  real 


number  used  as  a convergence  criterion. 

dTx. 

— 1*^1 

(7)  Compute  (|)^  = — 


If  (fi,  > 1 go  to  step  (8).  If 


4)^  < 0 go  to  step  (9).  The  value  of  c()^  cannot  lie  between  0 and  1. 
(8)  Update  the  matrix  [H] . 


["l+ll  " l**!'  - 


•5.yT[H.]  [H.lx-'S'!' 

— l-'-l  1 1 -^1—1 


^i^i 


6 .Y. 

— i-^x 


1 + 


li[Hi]li 


■^i^i 


T 

6.6, 

— 1— i 

xT 

1-X-! 


Go  to  step  (3). 

(9)  Update  the  matrix  [H] . 


(“i+ii  ■ + 


T 

6.6! 
— 1— i 

xT 

^i^i 


lJ[Hi]Xi 


Go  to  step  (3). 

The  correction  formula  of  step  (9)  is  identical  to  that  used  in  the 
Fletcher-Powell  method.  The  correction  formula  of  step  (8)  was  derived 
from  that  of  step  (9).  In  Fletcher's  Algorithm,  which  was  just  described, 
one-dimensional  searches  are  occasionally  performed,  but  only  if  an 
iteration  has  required  more  than  one  evaluation  of  the  function  and 
gradient  vector.  This  is  done  to  take  maximum  advantage  of  any  infor- 
mation available. 

The  most  recently  developed  optimization  method  is  the  Jacobson- 


Oksman  method.  This  method  is  more  general  than  the  previous  methods 
in  that  it  is  based  on  homogeneous  functions  rather  than  on  quadratic 
functions.  The  general  quadratic  function  has  the  form 
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f(x)  = J5(x-3)^[Q](x-1)  + f(l)  ; (B.2) 

where  [Q]  is  an  nxn  constant,  positive  definite  matrix;  ^ is  the 
location  of  the  minimum  point;  and  f (^)  is  the  value  of  f at  the  minimum 
point.  The  general  homogeneous  function  has  the  form 

f(x)  = Y + f(3.)  » (B.3) 

where  y is  the  degree  of  homogeneity.  A function  f is  a homogeneous 
equation  of  degree  y if  it  satisfies  the  identity  f(tx)  = t^f (x) , for 
a fixed  y.  Equation  (B.3)  is  much  more  general  than  (B.2),  with  (B.2) 
being  a special  case  of  (B.3)  when  y = 2.  In  the  quadratic  case  the 
Hessian  matrix  [Q]  is  a constant,  but  in  the  homogeneous  case  [Q]  need 
not  be  constant. 

The  Jacobson-Oksman  Algorithm  consists  of  the  following  steps. 

(1)  Start  with  an  estimate  of  the  minimum  point,  Set  y^  = 2 

and  CO  = 0.  Compute  f = f(x  ) and  c = g.(x  )• 

O O — O “O 

(2)  Set  Xj^  = ~ *^o  calculated  using  equation  (B.4). 

Compute  f^  and  If  f^  < f^  go  to  step  (3).  If  f^  > f^  use  cubic 

interpolation  until  f^^  < f^. 

(3)  Set  ^ = (x^,  y^,  w^)»  [Bq]  = [B]»  i = 0>  and  j = 1. 

(4)  If  5 or  < ^2  the  algorithm  stops, 

and  are  positive  real  constants  which  are  used  as  convergence 
criteria. 

(5)  Set  Xi+i  = (4+r  ^i+1’  compute  v.^^  = 

(6)  Update  the  matrix  [P] . 


ih+d  - '■'i'  - 


e is  a vector  having  zeros  for  all  elements  except  the  (j)th,  which 
-J 


is  1. 
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(7)  Calculate  = % + 


iPiis^(''i+rXi+i%) 


(8)  Set  i = i+1.  If  j = n+2  set  j = 1,  if  not  set  j = j+1. 

(9)  Set  , = X.  + D.a.(x.-B.).  a.  has  a magnitude  of  one  and 

—i+1  —1  1 —1  -^1  1 

T 

its  sign  is  minus  the  sign  of  (x.-R.)  g..  6.  is  taken  from  a.  which 

T T 

is  defined  as  oj^)  • 

(10)  Compute  and  If  < f^  go  to  step  (4).  If 

fj,,,  > f.  use  cubic  interpolation  until  f..,  < f.. 
i+1  - i ^ x+1  1 

The  quantity  is  calculated  using  the  equation 

p.  - mind, 

where  f . is  the  lower  bound  for  f,  and  y.  is  set  to  +2  if  v.  <0. 
min  1 'i  1 - 


The  vector  contains  successive  estimates  of  the  minimum  point 
the  degree  of  homogeneity  and  the  function  value  at  the  minimum 
times  Y^.  For  homogeneous  functions  the  Jacobson-Oksman  Algorithm  is 
guaranteed  to  converge  within  n+2  iterations,  where  n is  the  number  of 


variables. 

The  efficiency  of  optimization  methods  is  generally  determined  by 
minimizing  several  of  the  standard  test  functions  used  for  this  purpose. 
The  newer  methods  usually  are  compared  to  the  Fletcher-Powell  method. 

The  basis  of  comparison  is  the  number  of  evaluations  of  the  function 
and  gradient  vector  necessary  to  reach  convergence.  A problem  with  this 
method  of  comparison,  which  will  soon  become  apparent,  is  that  not 
everyone  has  the  same  version  of  the  Fletcher-Powell  method. 

The  results  of  some  comparisons  are  listed  in  Table  B-1.  The 
results  in  this  table  are  for  the  minimization  of  Rosenbrockfe  function 
using  the  three  methods  just  described  [31  ,35  , 36].  Each  of  the  three 
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Table  B-1 

Comparison  of  optimization  algorithm  efficiency  using 
Rosenbrock's  function. 


Number  of  evaluations  of 
the  function  and  gradients 

By  method 
on  left 

By  Fletcher- 
Powell  method 

Davidon's  Variance  Algorithm 

64 

101 

Fletcher's  Algorithm 

47 

64 

Jacobson-Oksman  Algorithm 

38 

167 
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references  obtained  different  results  using  the  Fletcher-Powell  method, 
but  in  spite  of  this,  it  is  apparent  that  the  Jacobson-Oksman  method 
performs  best  on  the  Rosenbrock  function.  All  three  of  the  newer  method 
will  probably  prove  to  be  superior  to  the  Fletcher-Powell  method  and 
the  Jacobson-Oksman  method  will  also  probably  be  the  best  of  the  three. 


APPENDIX  C 


EXPERIMENTAL  DETERMINATION  OF  SAMPLING  ERROR 


A computer  experiment  was  conducted  to  find  out  how  the  overall 
yield  and  overall  maximum  response  spread  may  vary  if  several  Monte 
Carlo  analyses  are  performed  using  the  same  set  of  element  tolerances. 
The  seed  integer  for  the  random  number  generator  must  be  changed  for 
each  analysis  in  order  to  avoid  having  exactly  the  same  results  each 
time.  This  experiment  was  performed  using  the  band-pass  filter  of 
Figure  5-6.  The  experiment  was  first  performed  using  a normal  element 
distribution  and  then  repeated  using  the  bimodal  element  distribution 
of  Figure  5-9. 

The  element  tolerances,  the  yields,  the  maximum  response  spreads, 
and  the  sample  sizes  of  the  analyses  are  listed  in  Tables  C-1  and  C-2. 
The  tolerance  value  is  the  difference  between  the  largest  value  and 
the  mean  value  of  a column  in  the  table.  The  tolerance  is  the 
difference  between  the  mean  value  and  the  smallest  value  in  the  column. 
The  normal  distribution  is  seen  to  have  smaller  yield  tolerances  than 
the  bimodal  distribution.  The  bimodal  distribution  appears  to  have 
smaller  tolerances  for  the  maximum  response  spread  than  does  the  normal 
distribution.  At  a sample  size  of  300  the  normal  distribution  has 
yield  tolerances  of  +0.91  and  -2.43,  which  are  larger  than  was  expected. 
However,  in  all  of  the  examples  in  this  work  the  continuous  tolerance 
design  algorithm  converged  to  within  yield  ranges  that  were  smaller  than 
the  yield  tolerances  indicated  by  this  experiment. 
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12,0 


Table  C-1 

Results  of  Monte  Carlo  analyses  using  normal  element 
value  distributions. 


(a) 


Percent  Yield 

Maximum  Response 

Spread 

Sample 

Size 

20 

100 

300 

20 

100 

300 

1 

100.00 

96.00 

97.33 

0.8092 

1.4532 

1.4520 

M 

2 

100.00 

99.00 

97.67 

0.8135 

1.0474 

1.2440 

rO 

e 

3 

100.00 

97.00 

96.67 

0.8778 

1.2005 

1.2079 

z 

CO 

•H 

4 

90.00 

92.00 

94.33 

1.2008 

1.4103 

1.3814 

CO 

CO 

5 

85.00 

93.00 

96.00 

1.3080 

1.2733 

1.2486 

c 

C 

6 

95.00 

96.00 

97.67 

1.4047 

1.4270 

1.4064 

7 

100.00 

98.00 

97.67 

0.8362 

1.0991 

1.3079 

Mean 

Value 

95.71 

95.86 

96.76 

1.0357 

1.2730 

1.3212 

+ 

Tolerance 

4.29 

3.14 

0.91 

0.3690 

0.1802 

0.1308 

Tolerance 

10.71 

3.86 

2.43 

0.2265 

0.2256 

0.1133 

(b) 


Element 

Number 

3 

4 

5 

6 

7 

8 

Percent 

Tolerance 

5.0 

10.0 

5.0 

5.0 

10.0 

3.0 
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Table  C-2 

Results  of  Monte  Carlo  analyses  using  bimodal  element 
value  distributions. 


(a) 


Sample 

Size 

Percent  Yield 

Maximum  Response 

Spread 

20 

100 

300 

20 

100 

300 

1 

60.00 

70.00 

66.00 

1.5413 

1.5770 

1.6941 

V.  2 

55.00 

60.00 

62.00 

1.7676 

1.7257 

2.0480 

.Q 

3 J 

z 

65.00 

61.00 

63.67 

1.7083 

1.6426 

1.7370 

A 

70.00 

65.00 

58.67 

1.7229 

1.7081 

1.7686 

^ s 

OJ  ^ 

70.00 

70.00 

66.00 

1.4933 

1.7053 

1.6771 

c 

6 

75.00 

66.00 

60.33 

1.6579 

1.7440 

1.7956 

7 

65.00 

65.00 

64.67 

1.4702 

1.8156 

1.7778 

Mean 

Value 

65.71 

65.29 

63.05 

1.6231 

1.7026 

1.7855 

+ 

Tolerance 

9.29 

4.71 

2.95 

0.1445 

0.1130 

0.2625 

Tolerance 

10.71 

5.29 

4.38 

0.1529 

0.1256 

0.1084 

(b) 


Element 

Number 

3 

4 

5 

6 

7 

8 

Percent 

Tolerance 

5.0 

5.0 

5.0 

5.0 

5.0 

3.0 
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The  distribution  of  yield  values  for  a very  large  number  of 
analyses  using  the  same  set  of  tolerances  is  believed  to  be  a normal 
one.  Thus  most  of  the  yield  values  will  be  close  to  the  mean  yield 
value.  A normal  yield  value  distribution  would  account  for  the  fact 
that  the  algorithm  converges  with  yield  ranges  smaller  than  the 
experimentally  determined  yield  tolerance. 

It  is  concluded  from  these  results  that  if  the  tolerance  design 
algorithms  are  used  in  practice,  that  a larger  maximum  sample  size 
(perhaps  500)  be  used  to  reduce  the  uncertainty  of  the  results. 
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